---
library_name: transformers
tags:
- cross-encoder
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

# Evaluation

### BEIR (NDCG@10)
Cross Encoders rerank top100 BM25 results

|                           | nq*        | fever*     | fiqa      | trec-covid   | scidocs   | scifact   | nfcorpus   | hotpotqa   | dbpedia-entity   | quora     | climate-fever   |
|:--------------------------|:----------|:----------|:----------|:-------------|:----------|:----------|:-----------|:-----------|:-----------------|:----------|:----------------|
| bm25                      | 0.305     | 0.638     | 0.238     | 0.589        | 0.150     | 0.676     | 0.318      | 0.629      | 0.319            | 0.787     | 0.163           |
| jina-reranker-v1-turbo-en | 0.533     | 0.852     | 0.336     | 0.774        | 0.166     | 0.739     | 0.353      | 0.745      | 0.421            | 0.858     | 0.233           |
| bge-reranker-v2-m3        | **0.597** | 0.857     | **0.397** | 0.784        | 0.169     | 0.731     | 0.336      | **0.794**  | **0.445**        | 0.858     | **0.314**       |
| mxbai-rerank-base-v1      | 0.535     | 0.767     | 0.382     | **0.830**    | **0.171** | 0.719     | **0.353**  | 0.668      | 0.416            | 0.747     | 0.253           |
| ms-marco-MiniLM-L-6-v2    | 0.523     | 0.801     | 0.349     | 0.741        | 0.164     | 0.688     | 0.349      | 0.724      | 0.445            | 0.825     | 0.244           |
| MiniLM-L-6-rerank-reborn      | 0.580     | **0.867** | 0.364     | 0.738        | 0.165     | **0.750** | 0.350      | 0.775      | 0.444            | **0.871** | 0.309           |

* Training splits of NQ and Fever were used as part of the training data.