Distily Project

community

https://github.com/lapp0/distily

AI & ML interests

None defined yet.

models 52

distily/distily_smollm_dataset_sweep

Updated Sep 30, 2024 • 228

distily/distily_tinyBenchmarks

Updated Sep 23, 2024 • 7

distily/distily_learning_params

Updated Sep 22, 2024 • 17

distily/distily_seq_len_batch_size

Updated Sep 17, 2024 • 42

distily/distily_distsmollm_max_length

Updated Sep 14, 2024 • 6

distily/distily_distsmollm_long

Updated Sep 14, 2024 • 20

distily/distily_additional_profiling

Updated Sep 13, 2024

distily/distily_profile_smollm_tritoned

Updated Sep 12, 2024 • 16

distily/distily_profile_smollm

Updated Sep 12, 2024 • 25

distily/distily_verify_new_attns

Updated Sep 12, 2024 • 25

datasets 10

distily/filtered_redpajama_en

Viewer • Updated Sep 7, 2024 • 2.21M • 62

distily/filtered_redpajama_multilingual

Viewer • Updated Sep 7, 2024 • 2.86M • 149 • 1

distily/synth_gpt2_t1_seq_1M

Viewer • Updated Aug 27, 2024 • 1M • 28

distily/synth_gpt2_ted_seq_100

Viewer • Updated Aug 26, 2024 • 1k • 27

distily/synth_gpt2_t1_seq_100K

Updated Aug 26, 2024 • 27

distily/synth_gpt2_ted_seq_100K

Viewer • Updated Aug 26, 2024 • 100k • 27

distily/synth_test

Viewer • Updated Aug 26, 2024 • 1k • 28

distily/synth_tdecay_gpt2_seq_1K

Viewer • Updated Aug 26, 2024 • 1k • 28

distily/synthetic_gpt2_sequences_1K

Viewer • Updated Aug 26, 2024 • 1k • 26

distily/c4_multilingual_1M

Viewer • Updated Aug 19, 2024 • 1M • 45 • 1