carlesoctav
commited on
Commit
•
b754048
1
Parent(s):
428504c
Update README.md
Browse files
README.md
CHANGED
@@ -8,6 +8,12 @@ tags:
|
|
8 |
|
9 |
---
|
10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
# carles-undergrad-thesis/st-indobert-mmarco-v1
|
12 |
|
13 |
This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
|
@@ -72,9 +78,13 @@ print(sentence_embeddings)
|
|
72 |
|
73 |
## Evaluation Results
|
74 |
|
75 |
-
<!--- Describe how your model was evaluated -->
|
76 |
|
77 |
-
|
|
|
|
|
|
|
|
|
|
|
78 |
|
79 |
|
80 |
## Training
|
|
|
8 |
|
9 |
---
|
10 |
|
11 |
+
This model utilizes a newer version of Sentence Transformers. If you're having trouble using this model, please try installing the latest version of Sentence Transformers with:
|
12 |
+
|
13 |
+
```bash
|
14 |
+
pip install --upgrade --force-reinstall --no-deps git+https://github.com/UKPLab/sentence-transformers.git
|
15 |
+
```
|
16 |
+
|
17 |
# carles-undergrad-thesis/st-indobert-mmarco-v1
|
18 |
|
19 |
This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
|
|
|
78 |
|
79 |
## Evaluation Results
|
80 |
|
|
|
81 |
|
82 |
+
| Model | Mmarco Dev | | MrTyDi Test | | Miracal Test | |
|
83 |
+
|-----------------------------------------|------------|----------------|-------------|----------------|--------------|----------------------------|
|
84 |
+
| | MRR@10 | R@1000 | MRR@10 | R@1000 | NCDG@10 | R@1K |
|
85 |
+
| $\text{BM25 (Elastic Search)}$ | .114 | .642 | .279 | .858 | .391 | .971 |
|
86 |
+
| $\text{IndoBERT}_{\text{DOT}}$ | .192 | .847 | .378 | .936 | .355 | .920 |
|
87 |
+
|
88 |
|
89 |
|
90 |
## Training
|