Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedaAlami
/
zephyr-7b-gemma-dpo
like
0
PEFT
TensorBoard
Safetensors
RedaAlami/PKU-SafeRLHF-Processed
gemma
alignment-handbook
trl
dpo
Generated from Trainer
4-bit precision
bitsandbytes
License:
other
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
zephyr-7b-gemma-dpo
Commit History
End of training
3a9c5a4
verified
RedaAlami
commited on
Jul 31, 2024
Model save
f9b279e
verified
RedaAlami
commited on
Jul 31, 2024
End of training
ea18965
verified
RedaAlami
commited on
Jul 31, 2024
Model save
7ae3c7a
verified
RedaAlami
commited on
Jul 31, 2024
initial commit
3da9ff5
verified
RedaAlami
commited on
Jul 31, 2024