philipphager
commited on
Commit
•
d1ebda3
1
Parent(s):
2acaa4b
Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ co2_eq_emissions:
|
|
23 |
A flax-based MonoBERT cross encoder trained on the [Baidu-ULTR](https://arxiv.org/abs/2207.03051) dataset with a **pointwise sigmoid cross-entropy loss on clicks**. The loss is called "naive" as we use user clicks as a signal of relevance without any additional position bias correction. For more info, [read our paper](https://arxiv.org/abs/2404.02543) and [find the code for this model here](https://github.com/philipphager/baidu-bert-model).
|
24 |
|
25 |
## Test Results on Baidu-ULTR
|
26 |
-
|
27 |
|
28 |
| Model | Log-likelihood | DCG@1 | DCG@3 | DCG@5 | DCG@10 | nDCG@10 | MRR@10 |
|
29 |
|------------------------------------------------------------------------------------------------|----------------|-------|-------|-------|--------|---------|--------|
|
|
|
23 |
A flax-based MonoBERT cross encoder trained on the [Baidu-ULTR](https://arxiv.org/abs/2207.03051) dataset with a **pointwise sigmoid cross-entropy loss on clicks**. The loss is called "naive" as we use user clicks as a signal of relevance without any additional position bias correction. For more info, [read our paper](https://arxiv.org/abs/2404.02543) and [find the code for this model here](https://github.com/philipphager/baidu-bert-model).
|
24 |
|
25 |
## Test Results on Baidu-ULTR
|
26 |
+
Ranking performance is measured in DCG, nDCG, and MRR on expert annotations (6,985 queries). Click prediction performance is measured in log-likelihood on one test partition of user clicks (≈297k queries).
|
27 |
|
28 |
| Model | Log-likelihood | DCG@1 | DCG@3 | DCG@5 | DCG@10 | nDCG@10 | MRR@10 |
|
29 |
|------------------------------------------------------------------------------------------------|----------------|-------|-------|-------|--------|---------|--------|
|