New Gemma 2 27B?

#3
by SamuelAzran - opened

I see it scored very low. Is this related to bugs reported in Google HF page? Please add the instruct variants as well. Shabbat Shalom

Open Hebrew LLM's Leaderboard org

Yes, it is related to the bugs. Removing it temporarily until the issues are resolved.

Is the issue resolved yet with the HF Gemma 27B?
It look like Gemma's tokenizer is better than Llama 3 in Hebrew and worth benchmarking.

Sign up or log in to comment