Hugging Face's logo

RTO-RL
/
Llama3-8B-TDPO

Safetensors
llama
Model card Files Community

Base model: OpenRLHF/Llama-3-8b-sft-mixture

Preference dataset: HuggingFaceH4/ultrafeedback_binarized

Downloads last month
14
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for RTO-RL/Llama3-8B-TDPO

Base model

OpenRLHF/Llama-3-8b-sft-mixture
Finetuned
(7)
this model
Quantizations
1 model

Dataset used to train RTO-RL/Llama3-8B-TDPO