Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-05

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
a4b7e39
•
1 Parent(s): 1501126

Training in progress, step 436

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3b92189a9ece11de987215db408ca80532d10231bdc68351533462d634a76d67
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd30ee41e457fe79dea76c14b44f41aee9f6f485a7a8547ee670119423bedfaa
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f25ebc969c053441e33bfad038a7d05a55df8bd0261ad94e990a78a328e28c17
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1eb45144dca80077fd398db86da88da719e9df28f744c85f533efab616fae043
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cea7da84346e534e90a5eb8c3e3b2327401b1f95d045cc247339a256df0049b8
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28f273bf878e66b1aeb2a0d1848b5eadd9ec433b0c0e63135ec5e34e4cf0043d
3
  size 4540516344