--- license: apache-2.0 language: - it - en pipeline_tag: text-generation datasets: - DeepMount00/o1-ITA-REASONING - DeepMount00/GPT-4o-ITA-INSTRUCT - DeepMount00/Sonnet-3.5-ITA-INSTRUCT - DeepMount00/open-perfectblend-ita ---

Alireo-400M 🤖 🇮🇹

A Lightweight Italian Language Model

Model Description 📝

Alireo-400M is a lightweight yet powerful Italian language model with 400M parameters, designed to provide efficient natural language processing capabilities while maintaining a smaller footprint compared to larger models.

Key Features ✨

* **Architecture**: Transformer-based language model 🏗️ * **Parameters**: 400M 📊 * **Context Window**: 8K tokens 🪟 * **Training Data**: Curated Italian text corpus (books, articles, web content) 📚 * **Model Size**: ~800MB 💾

Performance 📈

Despite its compact size, Alireo-400M demonstrates impressive performance: * **Benchmark Results**: Outperforms Qwen 0.5B across multiple benchmarks 🏆 * **Language Understanding**: Maintains high accuracy in Italian language understanding tasks 🎯 * **Speed**: Efficient inference speed due to optimized architecture ⚡

Limitations ⚠️

* Limited context window compared to larger models * May struggle with highly specialized technical content * Performance may vary on dialectal variations * Not suitable for multilingual tasks

Hardware Requirements 💻

* **Minimum RAM**: 2GB * **Recommended RAM**: 4GB * **GPU**: Optional, but recommended for faster inference * **Disk Space**: ~1GB (including model and dependencies)

Citation 📄

```bibtex @software{alireo2024, author = {[Michele Montebovi]}, title = {Alireo-400M: A Lightweight Italian Language Model}, year = {2024}, } ```