NPU LLM - a EmbeddedLLM Collection

EmbeddedLLM 's Collections

Onnxruntime DirectML GenAI

Onnxruntime CPU GenAI

NPU LLM

OpenVINO Model Server (OVMS)

NPU LLM

updated Sep 3, 2024

microsoft/Phi-3-mini-4k-instruct

Text Generation • 4B • Updated Sep 20, 2024 • 339k • • 1.24k
microsoft/Phi-3-mini-128k-instruct

Text Generation • 4B • Updated Mar 2 • 525k • • 1.66k
microsoft/Phi-3-medium-4k-instruct

Text Generation • 14B • Updated Mar 11 • 15.4k • 223
microsoft/Phi-3-medium-128k-instruct

Text Generation • 14B • Updated Aug 20, 2024 • 10.5k • 382