Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
73d237e
·
verified ·
1 Parent(s): 97605a7

Training in progress, step 400

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e480c69fc03ba744708d7d8a5c382c88a127bd65e8ea075493a7dea1f9fd8bdf
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aef3257242d19cd67a4eceab920c8f6baf15b98032c92c5362078a6b7eb21ac5
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b3e9fc534fe871e1211d2ed400a0d456c1c76dcad23890a5c5c5ade0e168738
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4889d4b59c14d621592bd6a9ae76581a0c87b18db694c79bca78f2ce4907429
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66a5f5fbd68f80e657a65e35bc1c6a0b81c1b342675f4df5b6196ab7995f2643
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a59e8db4f26bd220f32fb9a9b09d98bf1d533a4a786417370f5d90c673dd6df7
3
  size 4540516344