Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt-reward-scale-05

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
89a8449
·
verified ·
1 Parent(s): b54d083

Training in progress, step 200

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22ae8cb15969e0eef77f0350e4af2f425d33a81fdca070d9aebc0f46810f4e27
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69be24f9fdbe6c5aaa84a6985cfb2bc396a09469ce697e1083b8a80149122d1a
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77ae65ebff89239d7db62d686bd33aa42c1ce20e083f24155f23e113aada333f
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5aef8181cd81c03cda57695ae244f0404d7fb6c8d43fb8a33dbd295d10b1fcbf
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5eac10e4ac03f8f76e06e387d7e5cea44a687ed4b73be062a544516bf7ef88fe
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f002c8aba94f7daff84923d283afd985ac0faddbe149e1e0629b57c0abd64fbd
3
  size 4540516344