DynMoE Family - a LINs-lab Collection

LINs-lab 's Collections

DynMoE Family

updated Aug 19, 2024

DynMoE model checkpoints and paper on huggingface

LINs-lab/DynMoE-StableLM-1.6B

Text Generation • 3B • Updated Mar 24 • 11 • 2
LINs-lab/DynMoE-Qwen-1.8B

Text Generation • 3B • Updated Mar 24 • 16 • 2
LINs-lab/DynMoE-Phi-2-2.7B

Text Generation • 6B • Updated Mar 24 • 7 • 4
Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models

Paper • 2405.14297 • Published May 23, 2024 • 3