| <div align="center"> | |
| <picture> | |
| <img alt="specify theme context for images" src="https://raw.githubusercontent.com/01-ai/Yi/main/assets/img/Yi_logo_icon_light.svg" width="150px"> | |
| </picture> | |
| </div> | |
| <p align="center"> | |
| <a href="https://github.com/01-ai">🤗 HuggingFace</a> • | |
| <a href="https://www.modelscope.cn/organization/01ai/">🤖 ModelScope</a> • | |
| <a href="https://wisemodel.cn/organization/01.AI">✡️ WiseModel</a> | |
| <br/> | |
| <a href="https://github.com/01-ai/Yi-1.5">🐙 GitHub</a> • | |
| <a href="https://discord.gg/hYUwWddeAu">👾 Discord</a> • | |
| <a href="https://twitter.com/01ai_yi">🐤 Twitter</a> • | |
| <a href="https://github.com/01-ai/Yi/issues/43#issuecomment-1827285245">💬 WeChat</a> | |
| <br/> | |
| <a href="https://arxiv.org/abs/2403.04652">📝 Paper</a> • | |
| <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#faq">🙌 FAQ</a> • | |
| <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#learning-hub">📗 Learning Hub</a> | |
| </p> | |
| # Intro | |
| Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples. | |
| Compared with Yi, Yi-1.5 achieves stronger performance in coding, math, reasoning, and instruction following, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension. | |
| Model | Context Length | Pre-trained Tokens | |
| |---|---|--- | |
| Yi-1.5 | 4K |3.6T |