metadata

library_name: transformers
tags:
  - cross-encoder

Model Card for Model ID

Evaluation

Cross Encoders rerank top100 BM25 results

	nq*	fever*	fiqa	trec-covid	scidocs	scifact	nfcorpus	hotpotqa	dbpedia-entity	quora	climate-fever
bm25	0.305	0.638	0.238	0.589	0.150	0.676	0.318	0.629	0.319	0.787	0.163
jina-reranker-v1-turbo-en	0.533	0.852	0.336	0.774	0.166	0.739	0.353	0.745	0.421	0.858	0.233
bge-reranker-v2-m3	0.597	0.857	0.397	0.784	0.169	0.731	0.336	0.794	0.445	0.858	0.314
mxbai-rerank-base-v1	0.535	0.767	0.382	0.830	0.171	0.719	0.353	0.668	0.416	0.747	0.253
ms-marco-MiniLM-L-6-v2	0.523	0.801	0.349	0.741	0.164	0.688	0.349	0.724	0.445	0.825	0.244
MiniLM-L-6-rerank-reborn	0.580	0.867	0.364	0.738	0.165	0.750	0.350	0.775	0.444	0.871	0.309