llama-moe
/

LLaMA-MoE-v1-3_5B-4_16

Text Generation

Model card Files Files and versions Community

Spico commited on Jun 25

Commit

a9d7c3d

•

1 Parent(s): 52e67c7

Update README.md

Files changed (1) hide show

README.md +4 -5

README.md CHANGED Viewed

@@ -73,10 +73,9 @@ Training Data: 200B tokens from [SlimPajama](https://www.cerebras.net/blog/slimp
 ```bibtex
 @article{llama-moe,
   title={LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training},
-  author={LLaMA-MoE Team},
-  journal={arXiv},
-  year={2023},
-  volume={abs/},
-  url={https://arxiv.org}
 }
 ```

 ```bibtex
 @article{llama-moe,
   title={LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training},
+  author={Tong Zhu and Xiaoye Qu and Daize Dong and Jiacheng Ruan and Jingqi Tong and Conghui He and Yu Cheng},
+  journal={arXiv preprint arXiv:2406.16554},
+  year={2024},
+  url={https://arxiv.org/abs/2406.16554},
 }
 ```