metadata
title: README
emoji: 🏢
colorFrom: pink
colorTo: blue
sdk: static
pinned: false
LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.
All models under LLM360 will release:
- Up to 360 Intermediate Model Checkpoints
- Training Data with Full Data Sequence
- Training, Data Processing, and Evaluation Source Code
- Logs and Metrics
LLM360 is a collaboration between Petuum, MBZUAI, and Cerebras.