tintnguyen
commited on
Commit
•
83fc051
1
Parent(s):
12ac3ce
Update README.md
Browse files
README.md
CHANGED
@@ -228,7 +228,16 @@ You can finetune this model on your own dataset.
|
|
228 |
|
229 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
230 |
-->
|
|
|
231 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
232 |
## Training Details
|
233 |
|
234 |
### Training Dataset
|
|
|
228 |
|
229 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
230 |
-->
|
231 |
+
## Evaluation
|
232 |
|
233 |
+
### Metrics
|
234 |
+
|
235 |
+
#### Information Retrieval
|
236 |
+
|
237 |
+
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
|
238 |
+
```
|
239 |
+
{'aaa_cosine_accuracy@1': 0.6559, 'aaa_cosine_accuracy@3': 0.7988, 'aaa_cosine_accuracy@5': 0.8473, 'aaa_cosine_accuracy@10': 0.8915, 'aaa_cosine_precision@1': 0.6559, 'aaa_cosine_precision@3': 0.4683333333333332, 'aaa_cosine_precision@5': 0.39014000000000004, 'aaa_cosine_precision@10': 0.29126, 'aaa_cosine_recall@1': 0.14735861230027672, 'aaa_cosine_recall@3': 0.2534958821819028, 'aaa_cosine_recall@5': 0.3139822545058687, 'aaa_cosine_recall@10': 0.3978179383957577, 'aaa_cosine_ndcg@10': 0.4994592874617665, 'aaa_cosine_mrr@10': 0.7369935317460269, 'aaa_cosine_map@100': 0.3890462930756453}
|
240 |
+
```
|
241 |
## Training Details
|
242 |
|
243 |
### Training Dataset
|