Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt-reward-scale-05

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
3f979a2
•
1 Parent(s): 89a8449

Training in progress, step 300

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69be24f9fdbe6c5aaa84a6985cfb2bc396a09469ce697e1083b8a80149122d1a
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b9fea143b60d88f1ba144a8a751610e49ed231f08d6bb44e76790ea67cdeafb
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5aef8181cd81c03cda57695ae244f0404d7fb6c8d43fb8a33dbd295d10b1fcbf
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50ff27da74b7d5fec4620f25ec7bb4e940c9980659399af67e1d24d833661240
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f002c8aba94f7daff84923d283afd985ac0faddbe149e1e0629b57c0abd64fbd
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e76a3d451cad8df55a589428efaa0f941b98430f59fcccdc15b0d3ba2e79a88
3
  size 4540516344