This is an aligned model based on princeton-nlp/Llama-3-Base-8B-SFT. The alignment loss has two parts, preference loss and a regularization term. The alignment loss does not require the assumption of an existing underlying reward model. Moreover, the distribution's ``softness" is adjustable via the softmax exponent, an algorithm parameter.
More information will be added later.
- Downloads last month
- 9
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for sabersaleh/Llama3
Base model
princeton-nlp/Llama-3-Base-8B-SFT