| license: mit | |
| tags: | |
| - moe | |
| * [This is DPO improved version of cloudyu/Mixtral_11Bx2_MoE_19B](https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B) | |
| * [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) | |
| * metrics not test! |
| license: mit | |
| tags: | |
| - moe | |
| * [This is DPO improved version of cloudyu/Mixtral_11Bx2_MoE_19B](https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B) | |
| * [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) | |
| * metrics not test! |