Hugging Face's logo

lapp0
/
distily_bench_gpt2_activation_loss

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
03d5698
•
1 Parent(s): 6f853a5

Training in progress, step 24750

Browse files
Files changed (4) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_kl_divergence_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723642674.93d6cbb3ad53 +2 -2
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_soft_cross_entropy_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss/events.out.tfevents.1723642962.93d6cbb3ad53 +3 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_kl_divergence_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723642674.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34e963fd408db13313bbcc16a8abe43d7f22e52ae6afc3a39b02a9816340dddd
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e35a980cdaa4663ae586ac99d641136a1642781437b4c0c0d7a56cb332c5ab07
3
+ size 529
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_soft_cross_entropy_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss/events.out.tfevents.1723642962.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c0c9585039916842166d901d5ab88c7c28eb9edd6cbc63ef7aad1b20ead6596
3
+ size 6729497
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c9495ea14e6c2ebedf6ebe73240d587d782b4105889f51455a8e7e4254f6475
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:107cd27e6ff788a3afeb83e24d272ccc2b49b9198fde46f4ec5de04b23c3e4fa
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ed6853059e8b211ba0f61a8a79b94418b13983053a35e5585d2a82479479ca65
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3092f3951d5218418e3b7f7aa798b3a2ee3af331bdfa1bf2cc1484371529d59f
3
  size 907106756