Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
df0bdec
·
verified ·
1 Parent(s): a5168ad

Training in progress, step 437

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0e5cb8144d639562d65bb9d95dc76f6e94227acbef70005b55aeb1e2d7f0601
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ead16b9628a41169e8843433154de6ec3732ff3184342b29d4cb3f9f8060ba3a
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:11fbd96595cff73bffa9088e080505f764a27dd94ac55591edf2da87d1513dc8
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:544cdc601d4cf9d3fecdaa3b2a435bf4e5042db7a41e1337f21d5d1588994df1
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b6734fd9c3e8d4d4691d26cd2306c40c6ae6f3a17a0c79793ad54991621e301
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd8f12b7f6969c4aefe6942ab1f7887a6907fc1b1760e7b0d0a9f95b6b340695
3
  size 4540516344