distily
/

distily_multi_experiment

Generated from Trainer

Model card Files Files and versions Metrics Training metrics Community

distily_multi_experiment / logs /attn_loss_fn=cos, attn_weight=25.0, layer_mapper=last, projector=orthogonal

Commit History

Training in progress, step 61875

0678ec3
verified

lapp0 commited on Aug 23, 2024