README.md

metadata

datasets:
  - tdro-llm/finetune_data
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
base_model:
  - mistralai/Mistral-7B-v0.1

s2-tdro-Mistral-7B-v0.1-curr

Arxiv | Github

tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.

This is a fine-tuned tDRO optimized retriever with Sample Ratio Reweighting of tdro-llm/finetune_data.