Hugging Face's logo

lapp0
/
distily_bench_gpt2_attn

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
02d0c01
•
1 Parent(s): 542a4f1

Training in progress, step 12375

Browse files
Files changed (6) hide show
  1. logs/attn_loss_fn=cos, attn_weight=2.0/events.out.tfevents.1723660376.93d6cbb3ad53 +3 -0
  2. logs/attn_loss_fn=cos, attn_weight=2.0/events.out.tfevents.1723660668.93d6cbb3ad53 +3 -0
  3. logs/attn_loss_fn=mse, attn_weight=2.0/events.out.tfevents.1723660225.93d6cbb3ad53 +2 -2
  4. logs/attn_loss_fn=mse_sum, attn_weight=2.0/events.out.tfevents.1723660560.93d6cbb3ad53 +3 -0
  5. model.safetensors +1 -1
  6. training_args.bin +1 -1
logs/attn_loss_fn=cos, attn_weight=2.0/events.out.tfevents.1723660376.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97133f6f9344c094282d210b1606c3c04467e40c3649ad4ed446604efb2fca6f
3
+ size 5938
logs/attn_loss_fn=cos, attn_weight=2.0/events.out.tfevents.1723660668.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05736be84b77dc1428bb46d80262bf94b392abeb89138e5e9f943def238e8f18
3
+ size 3345958
logs/attn_loss_fn=mse, attn_weight=2.0/events.out.tfevents.1723660225.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:17a33e40555070df61c3730cf97614fbbead92007ee047df21579527a03296a1
3
- size 249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:600fc8fb168d0f5f382e035d56047cef1044d5ea67bd534479ff0c0070569973
3
+ size 520
logs/attn_loss_fn=mse_sum, attn_weight=2.0/events.out.tfevents.1723660560.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d173899ad3a2b80dd5f2709c824a957a48bda1a8d19614887d313d80717f380c
3
+ size 5942
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a0ec1453377d7bf4e231beb11459860f4cbd412ad0726105d10c4786ca76a6c
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1193860c9759bd190d23ed7c2f1dac17359b4c1ad9e5d5f27625d03ef1acd84b
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:80d3e5ed917d613007ba4a4ebff101a440047d550e395dc35044c6d2709142e0
3
  size 907106564
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fc918f3d2eaa317f4c5bd854e0482f4c26d9d9382fbbaadddba43db1a86faf0
3
  size 907106564