metadata
language:
- code
BLOOM (560M ckpt) fine-tuned on The Stack RUST code
Model
BigScience Large Open-science Open-access Multilingual Language Model
Dataset
Rust part of The Stack.
The Stack contains over 6TB of permissively-licensed source code files covering 358 programming languages. The dataset was created as part of the BigCode Project, an open scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs). The Stack serves as a pre-training dataset for Code LLMs, i.e., code-generating AI systems which enable the synthesis of programs from natural language descriptions as well as other from code snippets.