lapp0
/

distily_bench_gpt2_attn

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

distily_bench_gpt2_attn / logs /attn_loss_fn=reverse_kl, attn_weight=2.0 /events.out.tfevents.1723672816.93d6cbb3ad53

Commit History

Training in progress, step 12375

846aa58
verified

lapp0 commited on Aug 14, 2024