Hugging Face's logo

glorgao
/
SelectiveDPO-Mistral-7B-SFT-UFBinarized

Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

This model is fine-tuned from the HuggingFaceH4/mistral-7b-sft-beta model using the SelectiveDPO algorithm on the Ultrafeedback_binarized dataset.

For the recipe to reproduce this model, please visit our GitHub page.

Downloads last month
6
Safetensors
Model size
7.11B params
Tensor type
F32
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Model tree for glorgao/SelectiveDPO-Mistral-7B-SFT-UFBinarized

Base model

mistralai/Mistral-7B-v0.1
Finetuned
HuggingFaceH4/mistral-7b-sft-beta
Finetuned
(156)
this model

Dataset used to train glorgao/SelectiveDPO-Mistral-7B-SFT-UFBinarized

Collection including glorgao/SelectiveDPO-Mistral-7B-SFT-UFBinarized