Technical Report

#4
by kardosdrur - opened

Hi! I'm currently manually reviewing the top 200 models on MTEB, and while your model has been available for approximately a year, your technical report remains to be published.
Can we expect to get more information on your training procedure and data? Perhaps a preprint?

I just wanted to follow up on this. We are doing in effort in MTEB to annotate training data on our leaderboard so that users can know how well models generalize to out-of-domain data.
Since I have failed to recover information about your training data, and the technical report is still not released, we display a warning to our users indicating that we can't be sure where your otherwise impressive scores come from.

I would appreciate, if you could get back to me about this, and indicate if, and which datasets, you have used from the MTEB benchmarks to fine-tune this model.
Márton

just tagging you to make sure you see it: @w95

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment