README.md

metadata

datasets:
  - tdro-llm/finetune_data
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
base_model:
  - meta-llama/Meta-Llama-3-8B

s2-tdro-Llama-3-8B-top70

Arxiv | Github

tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.

This is a fine-tuned tDRO optimized retriever with Dataset Selection Top-70% of tdro-llm/finetune_data.