tags: | |
- yi | |
- moe | |
- DPO | |
license: apache-2.0 | |
* [This is DPO improved version of cloudyu/Yi-34Bx2-MoE-60B](https://huggingface.co/cloudyu/Yi-34Bx2-MoE-60B) | |
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) | |
* metrics not test! |
tags: | |
- yi | |
- moe | |
- DPO | |
license: apache-2.0 | |
* [This is DPO improved version of cloudyu/Yi-34Bx2-MoE-60B](https://huggingface.co/cloudyu/Yi-34Bx2-MoE-60B) | |
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) | |
* metrics not test! |