Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
2c7d48d
•
1 Parent(s): 133d893

Training in progress, step 300

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f386d5090276d4230cc8721b3a1a421926929d6d7bfee798709e1745b574b08a
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:342d2c3c2d6e3347c7827db1189dcfe2257929c09168ef9a55bd17c26d3bc2f1
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93131e618cc67d2e7985174f22e74ff7b7931d0cebb2c121b8f0e7fc10f1e87e
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3acd0e0fb2dd326c9fbabf2729d1a2eb1dd142ea6724ee2126fe837d07103381
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8cefd2141a68efd630baeeca28ff1f80fcba2f800cb5600d5f561a80b91de08d
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16e837ff91edbec2669e2b18412d1bce47fda330bafd9d0b42e403381de9d4cb
3
  size 4540516344