---
language:
- it
pipeline_tag: text-generation
widget:
- text: Alessandro è un bel ragazzo che progetta Infissi
- text: Melissa è una ragazza
tags:
- italian
- italiano
- llama
---
This is a work in progress of an italian llama2 model with train starting from 0 with the redpajama database (currently only 2023-14 ONLY ITALIAN)

Train on my server, i have studied and adapted the model starting from the repository https://github.com/karpathy/llama2.c

*** TRAIN IS NOT FINISHED ***

1024 max sequence length

num decayed parameter tensors: 225, with 251,068,416 parameters

num non-decayed parameter tensors: 65, with 49,920 parameters