distily
/

distily_multi_experiment

Generated from Trainer

Model card Files Files and versions Metrics Training metrics Community

distily_multi_experiment / logs /attn_loss_fn=cos, attn_weight=5, layer_mapper=last, projector=orthogonal

Commit History

End of training

b51142e
verified

lapp0 commited on Aug 23, 2024

Training in progress, step 61875

2095cb5
verified

lapp0 commited on Aug 23, 2024