antoinelouis
commited on
Commit
•
77e95d6
1
Parent(s):
1bd87bc
Update README.md
Browse files
README.md
CHANGED
@@ -200,6 +200,10 @@ We evaluate our model on the small development sets of [mMARCO](https://huggingf
|
|
200 |
| 3 | mColBERT ([Bonfacio et al., 2021](https://doi.org/10.48550/arXiv.2108.13897)) | multi-vector | 25.6M | 180M | 55.3 | 48.8 | 32.9 | 41.3 | 55.5 | 36.6 | 36.7 | 48.2 | 44.8 | 61.6 | 46.1 |
|
201 |
| 4 | **ColBERT-XM** (ours) | multi-vector | 6.4M | 277M | 55.2 | 56.6 | 36.0 | 41.8 | 57.1 | 42.1 | 41.3 | 52.2 | 56.8 | 50.6 | 49.0 |
|
202 |
| | | | | | | | | | **R@100** | | | | | | |
|
|
|
|
|
|
|
|
|
203 |
|
204 |
***
|
205 |
|
|
|
200 |
| 3 | mColBERT ([Bonfacio et al., 2021](https://doi.org/10.48550/arXiv.2108.13897)) | multi-vector | 25.6M | 180M | 55.3 | 48.8 | 32.9 | 41.3 | 55.5 | 36.6 | 36.7 | 48.2 | 44.8 | 61.6 | 46.1 |
|
201 |
| 4 | **ColBERT-XM** (ours) | multi-vector | 6.4M | 277M | 55.2 | 56.6 | 36.0 | 41.8 | 57.1 | 42.1 | 41.3 | 52.2 | 56.8 | 50.6 | 49.0 |
|
202 |
| | | | | | | | | | **R@100** | | | | | | |
|
203 |
+
| 5 | BM25 ([Pyserini](https://github.com/castorini/pyserini)) | lexical | - | - | 79.3 | 86.9 | 53.7 | 71.9 | 84.3 | 64.5 | 61.9 | 64.8 | 76.4 | 75.8 | 72.0 |
|
204 |
+
| 6 | mono-mT5 ([Bonfacio et al., 2021](https://doi.org/10.48550/arXiv.2108.13897)) | cross-encoder | 12.8M | 390M | 88.4 | 92.3 | 72.4 | 85.1 | 92.8 | 83.2 | 76.5 | 76.3 | 83.8 | 85.0 | 83.5 |
|
205 |
+
| 7 | mColBERT ([Bonfacio et al., 2021](https://doi.org/10.48550/arXiv.2108.13897)) | multi-vector | 25.6M | 180M | 85.9 | 91.8 | 78.6 | 82.6 | 91.1 | 70.9 | 72.9 | 86.1 | 80.8 | 96.9 | 83.7 |
|
206 |
+
| 8 | **ColBERT-XM** (ours) | multi-vector | 6.4M | 277M | 89.6 | 91.4 | 83.7 | 84.4 | 93.8 | 84.9 | 77.6 | 89.1 | 87.1 | 93.3 | 87.5 |
|
207 |
|
208 |
***
|
209 |
|