MiniLLM

community

https://github.com/microsoft/LMOps/tree/main/minillm

t1101675

AI & ML interests

Training efficient language models (MiniLLM, MiniPLM)

MiniLLM 's models 50

MiniLLM/KD-OPT-2.7B

Text Generation • Updated Sep 26, 2024 • 12

MiniLLM/KD-OPT-1.3B

Text Generation • Updated Sep 26, 2024 • 13

MiniLLM/SFT-OPT-6.7B

Text Generation • Updated Sep 26, 2024 • 80

MiniLLM/SFT-OPT-2.7B

Text Generation • Updated Sep 26, 2024 • 15

MiniLLM/SFT-OPT-1.3B

Text Generation • Updated Sep 26, 2024 • 20

MiniLLM/init-gpt2-340M

Text Generation • Updated Sep 26, 2024 • 16

MiniLLM/init-gpt2-760M

Text Generation • Updated Sep 26, 2024 • 15

MiniLLM/teacher-gpt2-1.5B

Text Generation • Updated Sep 26, 2024 • 203 • 3

MiniLLM/SeqKD-gpt2-120M

Text Generation • Updated Sep 26, 2024 • 13

MiniLLM/SeqKD-gpt2-760M

Text Generation • Updated Sep 26, 2024 • 14

MiniLLM/SeqKD-gpt2-340M

Text Generation • Updated Sep 26, 2024 • 20

MiniLLM/KD-gpt2-120M

Text Generation • Updated Sep 26, 2024 • 18

MiniLLM/KD-gpt2-340M

Text Generation • Updated Sep 26, 2024 • 24

MiniLLM/KD-gpt2-760M

Text Generation • Updated Sep 26, 2024 • 17

MiniLLM/SFT-gpt2-340M

Text Generation • Updated Sep 26, 2024 • 24

MiniLLM/MiniLLM-gpt2-120M

Text Generation • 0.1B • Updated Sep 26, 2024 • 190

MiniLLM/MiniLLM-OPT-6.7B

Text Generation • Updated Sep 26, 2024 • 32

MiniLLM/MiniLLM-OPT-2.7B

Text Generation • Updated Sep 26, 2024 • 35

MiniLLM/MiniLLM-OPT-1.3B

Text Generation • Updated Sep 26, 2024 • 34 • 1

MiniLLM/MiniLLM-gpt2-760M

Text Generation • Updated Sep 26, 2024 • 55