Safetensors
llama
File size: 371 Bytes
0d95e1b
 
 
 
 
57d5a6a
0d95e1b
 
57d5a6a
1
2
3
4
5
6
7
8
9
---
license: mit
datasets:
- HuggingFaceH4/ultrafeedback_binarized
base_model:
- princeton-nlp/Llama-3-Base-8B-SFT
---

This is an aligned model based on princeton-nlp/Llama-3-Base-8B-SFT. This model is aligned using the Ultrafeedback dataset, fine-tuned through the Simple Preference Optimization (SimPO) loss. The optimization process was conducted with a single epoch.