Add OctoPack

README.md

@@ -47,6 +47,20 @@ StarCoder is a 15.5B parameters language model for code trained for 1T tokens on
 - [StarCoder Search](https://huggingface.co/spaces/bigcode/search): Full-text search code in the pretraining dataset.
 - [StarCoder Membership Test](https://stack.dataportraits.org/): Blazing fast test if code was present in pretraining dataset.
 
+---
+
+## 🐙OctoPack
+OctoPack consists of data, evals & models relating to Code LLMs that follow human instructions.
+
+- [Paper](https://arxiv.org/abs/2308.07124): Research paper with details about all components of OctoPack.
+- [GitHub](https://github.com/bigcode-project/octopack): All code used for the creation of OctoPack.
+- [CommitPack](https://huggingface.co/datasets/bigcode/commitpack): 4TB of Git commits.
+- [Am I in the CommitPack](https://huggingface.co/spaces/bigcode/in-the-commitpack): Check if your code is in the CommitPack.
+- [CommitPackFT](https://huggingface.co/datasets/bigcode/commitpackft): 2GB of high-quality Git commits that resemble instructions.
+- [HumanEvalPack](https://huggingface.co/datasets/bigcode/humanevalpack): Benchmark for Code Fixing/Explaining/Synthesizing across Python/JavaScript/Java/Go/C++/Rust.
+- [OctoCoder](https://huggingface.co/bigcode/octocoder): Instruction tuned model of StarCoder by training on CommitPackFT.
+- [OctoCoder Demo](https://huggingface.co/spaces/bigcode/OctoCoder-Demo): Play with OctoCoder.
+- [OctoGeeX](https://huggingface.co/bigcode/octogeex): Instruction tuned model of CodeGeeX2 by training on CommitPackFT.
 
 ---