Hugging Face's logo
Flavio Catalani's picture
13 5 21

Flavio Catalani

fakezeta
muriloscezar's profile picture eramax's profile picture Dakshithanilame's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a model 5 days ago
fakezeta/DeepSeek-R1-Distill-Llama-8B-ov-int8
published a model 5 days ago
fakezeta/DeepSeek-R1-Distill-Llama-8B-ov-int8
liked a Space 7 days ago
Mistral-AI-Game-Jam/team13
View all activity

Organizations

LocalAI Community's profile picture

fakezeta's activity

updated a model 5 days ago
published a model 5 days ago
liked 2 Spaces 7 days ago
reacted to csabakecskemeti's post with 👀 9 days ago
view post
Post
2289
I've run the open llm leaderboard evaluations + hellaswag on deepseek-ai/DeepSeek-R1-Distill-Llama-8B and compared to meta-llama/Llama-3.1-8B-Instruct and at first glance R1 do not beat Llama overall.

If anyone wants to double check the results are posted here:
https://github.com/csabakecskemeti/lm_eval_results

Am I made some mistake, or (at least this distilled version) not as good/better than the competition?

I'll run the same on the Qwen 7B distilled version too.
·
upvoted a collection 9 days ago
liked a Space 2 months ago
liked a model 2 months ago
upvoted an article 2 months ago
view article
Article

🐺🐦‍⬛ LLM Comparison/Test: 25 SOTA LLMs (including QwQ) through 59 MMLU-Pro CS benchmark runs

By wolfram •
• 76
reacted to lunarflu's post with 🔥 2 months ago
liked 2 models 2 months ago
liked a Space 4 months ago
New activity in mistralai/Mistral-Small-Instruct-2409 5 months ago

Please make it CLEAR, this is NOT an OPEN SOURCE MODEL license

4
#15 opened 5 months ago by
KingBadger
updated 3 models 5 months ago
updated a collection 5 months ago
updated a model 5 months ago