Ma787639046
commited on
Commit
•
05bb7f1
1
Parent(s):
a971e65
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,8 @@ tags:
|
|
10 |
|
11 |
# bowdpr_marco_ft
|
12 |
|
13 |
-
This is a fine-tuned retriever on the MS-MARCO Passage Ranking Task (without distillation). We introduce a novel pre-training paradigm, Bag-of-Word Prediction, for dense retrieval.
|
|
|
14 |
|
15 |
Finetuning on MS-MARCO dataset involves a two-stage pipeline
|
16 |
- s1: BM25 negs
|
|
|
10 |
|
11 |
# bowdpr_marco_ft
|
12 |
|
13 |
+
This is a fine-tuned retriever on the MS-MARCO Passage Ranking Task (without distillation). We introduce a novel pre-training paradigm, Bag-of-Word Prediction, for dense retrieval.
|
14 |
+
This retriever is initialized from a base-sized pre-trained model, [bowdpr/bowdpr_marco](https://huggingface.co/bowdpr/bowdpr_marco). Please refer to our [paper](https://arxiv.org/abs/2401.11248) for detailed pre-training and fine-tuning settings.
|
15 |
|
16 |
Finetuning on MS-MARCO dataset involves a two-stage pipeline
|
17 |
- s1: BM25 negs
|