nickprock/Italian-ModernBERT-base-embed-mmarco-mnrl
Sentence Similarity
โข
Updated
โข
5
โข
3
Stefano Fiorucci PRO
anakin87
AI & ML interests
Contributing to Haystack LLM framework ๐๏ธ. Language Models: orchestration, post-training, synthetic data...
Recent Activity
liked
a model
about 10 hours ago
nickprock/Italian-ModernBERT-base-embed-mmarco-mnrl
liked
a model
about 10 hours ago
nickprock/Italian-ModernBERT-base-embed-mmarco-triplet
liked
a dataset
4 days ago
fedric95/AIME2025-ita
Organizations
anakin87's activity
liked
2
models
about 10 hours ago
liked
a
dataset
4 days ago
upvoted
an
article
8 days ago
Article
Argunauts Training Phase II: Selfplay Finetuning Line-By-Line
By
โข
โข
5
updated
a
collection
10 days ago
liked
a
model
13 days ago
upvoted
an
article
16 days ago
Article
Fine-tune Deepseek-R1 with a Synthetic Reasoning Dataset
By
โข
โข
39
updated
a
collection
20 days ago
updated
a
collection
25 days ago
liked
2
models
26 days ago
liked
a
dataset
28 days ago
liked
2
datasets
about 1 month ago
Fine-tuning Hyperparameters
8
#27 opened 8 months ago
by
tanliboy
liked
a
dataset
about 1 month ago
replied to
their
post
about 1 month ago
Ok, I understand...
In the past, I've also fine-tuned models with different licenses.
You may be interested in https://huggingface.co/anakin87/Phi-3.5-mini-ITA (MIT license).
upvoted
an
article
about 1 month ago
Article
Fine-tune ModernBERT for RAG with Synthetic Data
By
and 2 others
โข
โข
36
posted
an
update
about 1 month ago
Post
1638
๐๐๐ฐ ๐๐ญ๐๐ฅ๐ข๐๐ง ๐๐ฆ๐๐ฅ๐ฅ ๐๐๐ง๐ ๐ฎ๐๐ ๐ ๐๐จ๐๐๐ฅ๐ฌ: ๐๐๐ฆ๐ฆ๐ ๐๐๐จ๐ ๐๐ง๐๐ฌ๐ข๐ฌ ๐๐จ๐ฅ๐ฅ๐๐๐ญ๐ข๐จ๐ง ๐๐๐ฎ๐น
I am happy to release two new language models for the Italian Language!
๐ช Gemma 2 9B Neogenesis ITA
anakin87/gemma-2-9b-neogenesis-ita
Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data.
Using Spectrum, I trained 20% of model layers.
๐ Evaluated on the Open ITA LLM leaderboard ( mii-llm/open_ita_llm_leaderboard), this model achieves strong performance.
To beat it on this benchmark, you'd need a 27B model ๐
๐ค Gemma 2 2B Neogenesis ITA
anakin87/gemma-2-2b-neogenesis-ita
This smaller variant is fine-tuned from the original Gemma 2 2B it by Google.
Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum.
๐ Compared to the original model, it shows improved Italian proficiency, good for its small size.
Both models were developed during the recent #gemma competition on Kaggle.
๐ Training code: https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond
๐ Thanks @FinancialSupport and mii-llm for the help during evaluation.
I am happy to release two new language models for the Italian Language!
๐ช Gemma 2 9B Neogenesis ITA
anakin87/gemma-2-9b-neogenesis-ita
Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data.
Using Spectrum, I trained 20% of model layers.
๐ Evaluated on the Open ITA LLM leaderboard ( mii-llm/open_ita_llm_leaderboard), this model achieves strong performance.
To beat it on this benchmark, you'd need a 27B model ๐
๐ค Gemma 2 2B Neogenesis ITA
anakin87/gemma-2-2b-neogenesis-ita
This smaller variant is fine-tuned from the original Gemma 2 2B it by Google.
Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum.
๐ Compared to the original model, it shows improved Italian proficiency, good for its small size.
Both models were developed during the recent #gemma competition on Kaggle.
๐ Training code: https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond
๐ Thanks @FinancialSupport and mii-llm for the help during evaluation.
-
- 3 replies
updated
a
Space
about 1 month ago