Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt-reward-scale-05

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
7b08247
•
1 Parent(s): 03f77ed

Training in progress, step 436

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24551134a81d0e8ed769c485e795490e035aa50390639f62212c9df1953999b3
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94471c8f16f3ef1e863bc713de005404f0b4e00ebd6a1fd9f11057b64399e6d4
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f106e3b20ce4acd196adcfb16953c09af96c5970668fb8a922832fb89249df4
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa02efacc8b4a11ea44b76e1523eb0dab68e840cefd5584f389e07cf4339aef2
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e36934091d6ca3d22ab7d04eea5c3bffd7bcc06a8d53de5f1e26f690411e805
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3304ab6e41e497d269a92e459f7fbe3e0c40021d7284db90ce72ada43ee0ab73
3
  size 4540516344