| library_name: transformers | |
| datasets: | |
| - HuggingFaceH4/ultrafeedback_binarized | |
| base_model: | |
| - glorgao/Qwen2.5-7B-SFT | |
| This model is fine-tuned from the glorgao/Qwen2.5-7B-SFT model using the SelectiveDPO algorithm on the Ultrafeedback_binarized dataset. | |
| For the recipe to reproduce this model, please visit our [GitHub page](https://github.com/glorgao/SelectiveDPO). |