lapp0
/

distily_bench_gpt2_attn

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

distily_bench_gpt2_attn / logs /attn_loss_fn=reverse_kl, attn_weight=2.0

Commit History

End of training

74537bd
verified

lapp0 commited on Aug 14, 2024

Training in progress, step 12375

846aa58
verified

lapp0 commited on Aug 14, 2024