distily
/

distily_verify_new_attns

Generated from Trainer

Model card Files Files and versions Metrics Training metrics Community

distily_verify_new_attns / logs

1 contributor

History: 72 commits

lapp0's picture

Training in progress, step 25000

d6a7e7d verified 5 months ago

attn_loss_fn=kl, attn_norm=None, attn_projector=None, per_device_train_batch_size=8
Training in progress, step 120000 5 months ago
attn_loss_fn=kl, attn_norm=None, attn_projector=None
Training in progress, step 5000 5 months ago
attn_norm=None, attn_projector=mlp
Training in progress, step 20000 5 months ago
attn_norm=None
Training in progress, step 25000 5 months ago
attn_weight=0.0
Training in progress, step 5000 5 months ago
learning_rate=0.0002
Training in progress, step 5000 5 months ago
completed.flag

0 Bytes

Training in progress, step 5000 5 months ago
events.out.tfevents.1725999952.17c9bc68f863

1.99 MB
LFS

End of training 5 months ago
events.out.tfevents.1726032043.17c9bc68f863

529 Bytes
LFS

End of training 5 months ago