---
datasets:
- allenai/c4
language:
- en
library_name: transformers
license: apache-2.0
---
## Model Description

This is a model using the llama2 architecture and only 30 million parameters. It is trained on approximately 2 billion tokens of diverse web data from the first 1000000 rows of the uncleaned c4 english dataset.