Text Retrieval
sentence-transformers
Safetensors
Amharic
xlm-roberta
sparse-encoder
sparse
splade
Generated from Trainer
dataset_size:245876
loss:SpladeLoss
loss:SparseMultipleNegativesRankingLoss
loss:FlopsLoss
Eval Results (legacy)
Instructions to use rasyosef/splade-amharic-medium with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use rasyosef/splade-amharic-medium with sentence-transformers:
from sentence_transformers import SparseEncoder model = SparseEncoder("rasyosef/splade-amharic-medium") queries = ["Which planet is known as the Red Planet?"] documents = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", ] query_embeddings = model.encode_query(queries) document_embeddings = model.encode_document(documents) similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,21 +7,10 @@ language:
|
|
| 7 |
library_name: sentence-transformers
|
| 8 |
license: mit
|
| 9 |
metrics:
|
| 10 |
-
- dot_accuracy@1
|
| 11 |
-
- dot_accuracy@3
|
| 12 |
-
- dot_accuracy@5
|
| 13 |
-
- dot_accuracy@10
|
| 14 |
-
- dot_precision@1
|
| 15 |
-
- dot_precision@3
|
| 16 |
-
- dot_precision@5
|
| 17 |
-
- dot_precision@10
|
| 18 |
-
- dot_recall@1
|
| 19 |
-
- dot_recall@3
|
| 20 |
- dot_recall@5
|
| 21 |
- dot_recall@10
|
| 22 |
- dot_ndcg@10
|
| 23 |
- dot_mrr@10
|
| 24 |
-
- dot_map@100
|
| 25 |
- query_active_dims
|
| 26 |
- query_sparsity_ratio
|
| 27 |
- corpus_active_dims
|
|
@@ -87,36 +76,6 @@ model-index:
|
|
| 87 |
name: Amharic Passage Retrieval Dataset V2
|
| 88 |
type: rasyosef/Amharic-Passage-Retrieval-Dataset-V2
|
| 89 |
metrics:
|
| 90 |
-
- type: dot_accuracy@1
|
| 91 |
-
value: 0.6285881663737551
|
| 92 |
-
name: Dot Accuracy@1
|
| 93 |
-
- type: dot_accuracy@3
|
| 94 |
-
value: 0.8107791446983011
|
| 95 |
-
name: Dot Accuracy@3
|
| 96 |
-
- type: dot_accuracy@5
|
| 97 |
-
value: 0.8580843585237259
|
| 98 |
-
name: Dot Accuracy@5
|
| 99 |
-
- type: dot_accuracy@10
|
| 100 |
-
value: 0.895577035735208
|
| 101 |
-
name: Dot Accuracy@10
|
| 102 |
-
- type: dot_precision@1
|
| 103 |
-
value: 0.6285881663737551
|
| 104 |
-
name: Dot Precision@1
|
| 105 |
-
- type: dot_precision@3
|
| 106 |
-
value: 0.2702597148994337
|
| 107 |
-
name: Dot Precision@3
|
| 108 |
-
- type: dot_precision@5
|
| 109 |
-
value: 0.17161687170474518
|
| 110 |
-
name: Dot Precision@5
|
| 111 |
-
- type: dot_precision@10
|
| 112 |
-
value: 0.0895577035735208
|
| 113 |
-
name: Dot Precision@10
|
| 114 |
-
- type: dot_recall@1
|
| 115 |
-
value: 0.6285881663737551
|
| 116 |
-
name: Dot Recall@1
|
| 117 |
-
- type: dot_recall@3
|
| 118 |
-
value: 0.8107791446983011
|
| 119 |
-
name: Dot Recall@3
|
| 120 |
- type: dot_recall@5
|
| 121 |
value: 0.8580843585237259
|
| 122 |
name: Dot Recall@5
|
|
@@ -129,9 +88,6 @@ model-index:
|
|
| 129 |
- type: dot_mrr@10
|
| 130 |
value: 0.7282295240884877
|
| 131 |
name: Dot Mrr@10
|
| 132 |
-
- type: dot_map@100
|
| 133 |
-
value: 0.731417730197726
|
| 134 |
-
name: Dot Map@100
|
| 135 |
- type: query_active_dims
|
| 136 |
value: 60.95884704589844
|
| 137 |
name: Query Active Dims
|
|
@@ -223,21 +179,10 @@ print(similarities)
|
|
| 223 |
|
| 224 |
| Metric | Value |
|
| 225 |
|:----------------------|:-----------|
|
| 226 |
-
| dot_accuracy@1 | 0.6286 |
|
| 227 |
-
| dot_accuracy@3 | 0.8108 |
|
| 228 |
-
| dot_accuracy@5 | 0.8581 |
|
| 229 |
-
| dot_accuracy@10 | 0.8956 |
|
| 230 |
-
| dot_precision@1 | 0.6286 |
|
| 231 |
-
| dot_precision@3 | 0.2703 |
|
| 232 |
-
| dot_precision@5 | 0.1716 |
|
| 233 |
-
| dot_precision@10 | 0.0896 |
|
| 234 |
-
| dot_recall@1 | 0.6286 |
|
| 235 |
-
| dot_recall@3 | 0.8108 |
|
| 236 |
| dot_recall@5 | 0.8581 |
|
| 237 |
| dot_recall@10 | 0.8956 |
|
| 238 |
| **dot_ndcg@10** | **0.7694** |
|
| 239 |
| dot_mrr@10 | 0.7282 |
|
| 240 |
-
| dot_map@100 | 0.7314 |
|
| 241 |
| query_active_dims | 60.9588 |
|
| 242 |
| query_sparsity_ratio | 0.9981 |
|
| 243 |
| corpus_active_dims | 117.9303 |
|
|
|
|
| 7 |
library_name: sentence-transformers
|
| 8 |
license: mit
|
| 9 |
metrics:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
- dot_recall@5
|
| 11 |
- dot_recall@10
|
| 12 |
- dot_ndcg@10
|
| 13 |
- dot_mrr@10
|
|
|
|
| 14 |
- query_active_dims
|
| 15 |
- query_sparsity_ratio
|
| 16 |
- corpus_active_dims
|
|
|
|
| 76 |
name: Amharic Passage Retrieval Dataset V2
|
| 77 |
type: rasyosef/Amharic-Passage-Retrieval-Dataset-V2
|
| 78 |
metrics:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 79 |
- type: dot_recall@5
|
| 80 |
value: 0.8580843585237259
|
| 81 |
name: Dot Recall@5
|
|
|
|
| 88 |
- type: dot_mrr@10
|
| 89 |
value: 0.7282295240884877
|
| 90 |
name: Dot Mrr@10
|
|
|
|
|
|
|
|
|
|
| 91 |
- type: query_active_dims
|
| 92 |
value: 60.95884704589844
|
| 93 |
name: Query Active Dims
|
|
|
|
| 179 |
|
| 180 |
| Metric | Value |
|
| 181 |
|:----------------------|:-----------|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 182 |
| dot_recall@5 | 0.8581 |
|
| 183 |
| dot_recall@10 | 0.8956 |
|
| 184 |
| **dot_ndcg@10** | **0.7694** |
|
| 185 |
| dot_mrr@10 | 0.7282 |
|
|
|
|
| 186 |
| query_active_dims | 60.9588 |
|
| 187 |
| query_sparsity_ratio | 0.9981 |
|
| 188 |
| corpus_active_dims | 117.9303 |
|