distily
/

distily_multi_experiment

Generated from Trainer

Model card Files Files and versions Metrics Training metrics Community

distily_multi_experiment / logs /attn_loss_fn=cos, attn_weight=25.0, layer_mapper=layer-2, projector=orthogonal

Commit History

End of training

a137d80
verified

lapp0 commited on Aug 23, 2024

Training in progress, step 61875

9f73e81
verified

lapp0 commited on Aug 23, 2024