Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
dfrees
/
llama-1b-instruct-dpo
like
0
PEFT
Safetensors
llama
4-bit precision
bitsandbytes
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Use this model
fba78d6
llama-1b-instruct-dpo
/
config.json
Commit History
Uploading DPO-trained model
fba78d6
verified
dfrees
commited on
Oct 8, 2024