tintnguyen commited on
Commit
83fc051
1 Parent(s): 12ac3ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -228,7 +228,16 @@ You can finetune this model on your own dataset.
228
 
229
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
230
  -->
 
231
 
 
 
 
 
 
 
 
 
232
  ## Training Details
233
 
234
  ### Training Dataset
 
228
 
229
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
230
  -->
231
+ ## Evaluation
232
 
233
+ ### Metrics
234
+
235
+ #### Information Retrieval
236
+
237
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
238
+ ```
239
+ {'aaa_cosine_accuracy@1': 0.6559, 'aaa_cosine_accuracy@3': 0.7988, 'aaa_cosine_accuracy@5': 0.8473, 'aaa_cosine_accuracy@10': 0.8915, 'aaa_cosine_precision@1': 0.6559, 'aaa_cosine_precision@3': 0.4683333333333332, 'aaa_cosine_precision@5': 0.39014000000000004, 'aaa_cosine_precision@10': 0.29126, 'aaa_cosine_recall@1': 0.14735861230027672, 'aaa_cosine_recall@3': 0.2534958821819028, 'aaa_cosine_recall@5': 0.3139822545058687, 'aaa_cosine_recall@10': 0.3978179383957577, 'aaa_cosine_ndcg@10': 0.4994592874617665, 'aaa_cosine_mrr@10': 0.7369935317460269, 'aaa_cosine_map@100': 0.3890462930756453}
240
+ ```
241
  ## Training Details
242
 
243
  ### Training Dataset