Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
OpenVINO
's Collections
Visual Language Models
Image Generation
Speculative Decoding Draft Models
Speech-to-Text
LLM
LLMs optimized for NPU
LLM
updated
Jul 9
Collection of OpenVINO optimized LLMs
Upvote
41
+31
OpenVINO/phi-2-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
153
•
1
OpenVINO/phi-2-int8-ov
Text Generation
•
Updated
Oct 29, 2024
•
41
OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation
•
Updated
Dec 4, 2024
•
350
•
1
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation
•
Updated
Nov 11, 2024
•
42
OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation
•
Updated
Oct 29, 2024
•
157
OpenVINO/codegen25-7b-multi-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
•
4
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
•
4
OpenVINO/notus-7b-v1-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/notus-7b-v1-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
46
OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
114
•
1
OpenVINO/zephyr-7b-beta-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/zephyr-7b-beta-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
31
OpenVINO/dolly-v2-3b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/dolly-v2-3b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/dolly-v2-3b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/codegen2-3_7B_P-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
3
OpenVINO/codegen2-3_7B_P-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
2
OpenVINO/zephyr-7b-beta-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
10
OpenVINO/codegen2-3_7B_P-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
3
•
1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
74
•
2
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation
•
Updated
Oct 31, 2024
•
23.2k
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
1.75k
OpenVINO/gpt-neox-20b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
11
OpenVINO/gpt-neox-20b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/gpt-j-6b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/gpt-j-6b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
10
OpenVINO/gpt-j-6b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
12
OpenVINO/falcon-7b-instruct-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
10
OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/falcon-7b-instruct-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/open_llama_7b_v2-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/open_llama_7b_v2-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/open_llama_3b_v2-int8-ov
Text Generation
•
Updated
Oct 29, 2024
•
18
•
1
OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/phi-2-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
17
•
1
OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
27
•
1
OpenVINO/notus-7b-v1-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
24
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
4
OpenVINO/dolly-v2-7b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation
•
Updated
Oct 29, 2024
•
25
•
1
OpenVINO/dolly-v2-12b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation
•
Updated
Oct 31, 2024
•
856
•
1
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
12
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/pythia-12b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/pythia-2.8b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/pythia-2.8b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/pythia-12b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/pythia-6.9b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/pythia-6.9b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/pythia-2.8b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/pythia-6.9b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/pythia-1b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
10
OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
7
OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
8
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation
•
Updated
Oct 29, 2024
•
10
•
3
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/mpt-7b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
15
OpenVINO/mpt-7b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
10
OpenVINO/starcoder2-15b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/starcoder2-15b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
27
OpenVINO/starcoder2-15b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/starcoder2-7b-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
6
OpenVINO/starcoder2-7b-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
9
OpenVINO/starcoder2-7b-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
5
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov
Text Generation
•
Updated
Nov 25, 2024
•
69
•
3
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation
•
Updated
Nov 5, 2024
•
11
OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation
•
Updated
Oct 31, 2024
•
24
•
2
OpenVINO/Phi-3-mini-4k-instruct-int4-ov
Text Generation
•
Updated
Nov 25, 2024
•
1.48k
•
2
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
49
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation
•
Updated
Nov 5, 2024
•
91
•
5
OpenVINO/open_llama_3b_v2-int4-ov
Text Generation
•
Updated
Nov 5, 2024
•
16
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov
Updated
Jul 29
•
7
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov
Updated
Jul 29
•
5
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov
Updated
Jul 29
•
7
OpenVINO/gemma-2b-it-fp16-ov
Updated
Nov 20, 2024
•
5
OpenVINO/gemma-2b-it-int8-ov
Updated
Nov 25, 2024
•
24
OpenVINO/gemma-2b-it-int4-ov
Updated
Nov 25, 2024
•
1.18k
OpenVINO/gemma-7b-fp16-ov
Updated
Nov 5, 2024
•
5
OpenVINO/gemma-7b-int4-ov
Updated
Nov 5, 2024
•
13
OpenVINO/gemma-7b-int8-ov
Updated
Nov 5, 2024
•
4
OpenVINO/gemma-7b-it-int8-ov
Updated
Nov 5, 2024
•
37
OpenVINO/gemma-7b-it-fp16-ov
Updated
Nov 5, 2024
•
4
OpenVINO/gemma-7b-it-int4-ov
Updated
Nov 5, 2024
•
7
OpenVINO/bloomz-3b-int8-ov
Updated
Nov 5, 2024
•
5
OpenVINO/bloomz-3b-int4-ov
Updated
Nov 5, 2024
•
6
OpenVINO/bloomz-3b-fp16-ov
Updated
Nov 5, 2024
•
10
OpenVINO/codegen-6B-multi-int4-ov
Updated
Nov 5, 2024
•
4
OpenVINO/codegen-6B-multi-fp16-ov
Updated
Nov 5, 2024
•
8
OpenVINO/codegen-6B-multi-int8-ov
Updated
Nov 5, 2024
•
13
OpenVINO/Phi-3.5-mini-instruct-fp16-ov
Updated
Nov 25, 2024
•
5
OpenVINO/Phi-3.5-mini-instruct-int8-ov
Updated
Nov 25, 2024
•
6
OpenVINO/Phi-3.5-mini-instruct-int4-ov
Updated
Nov 25, 2024
•
1.74k
•
4
OpenVINO/gemma-2-9b-it-int4-ov
Updated
Nov 25, 2024
•
24
OpenVINO/gemma-2-9b-it-int8-ov
Updated
Nov 25, 2024
•
9
OpenVINO/gemma-2-9b-it-fp16-ov
Updated
Nov 25, 2024
•
38
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-fp16-ov
Updated
Mar 20
•
26
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-int8-ov
Updated
Mar 20
•
17
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-int4-ov
Updated
Mar 20
•
2.28k
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-int4-ov
Updated
Mar 24
•
1.78k
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-int8-ov
Updated
Mar 24
•
22
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-fp16-ov
Updated
Mar 24
•
12
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-fp16-ov
Updated
Mar 31
•
11
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-int8-ov
Updated
Mar 31
•
60
•
1
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-int4-ov
Updated
Mar 31
•
58
OpenVINO/Qwen2.5-1.5B-Instruct-fp16-ov
Updated
Apr 28
•
5
OpenVINO/Qwen2.5-1.5B-Instruct-int4-ov
Updated
Apr 28
•
42
OpenVINO/Qwen2.5-1.5B-Instruct-int8-ov
Updated
Apr 28
•
196
OpenVINO/Qwen2.5-14B-Instruct-int4-ov
Updated
Apr 28
•
9
OpenVINO/Qwen2.5-14B-Instruct-int8-ov
Updated
Apr 28
•
8
OpenVINO/Qwen2.5-14B-Instruct-fp16-ov
Updated
Apr 28
•
7
OpenVINO/Qwen2.5-7B-Instruct-fp16-ov
Updated
Apr 28
•
6
OpenVINO/Qwen2.5-7B-Instruct-int8-ov
Updated
Apr 28
•
54
OpenVINO/Qwen2.5-7B-Instruct-int4-ov
Updated
Apr 28
•
1.95k
•
2
OpenVINO/Phi-4-mini-instruct-int4-ov
Text Generation
•
Updated
Apr 16
•
1.61k
•
1
OpenVINO/Phi-4-mini-instruct-int8-ov
Text Generation
•
Updated
Apr 16
•
140
OpenVINO/Phi-4-mini-instruct-fp16-ov
Text Generation
•
Updated
Apr 16
•
45
OpenVINO/Qwen2-0.5B-Instruct-fp16-ov
Updated
Apr 24
•
27
OpenVINO/Qwen2-0.5B-Instruct-int8-ov
Updated
Apr 24
•
9
OpenVINO/Qwen2-0.5B-Instruct-int4-ov
Updated
Apr 24
•
7
OpenVINO/Qwen2-0.5B-int8-ov
Updated
Apr 24
•
6
OpenVINO/Qwen2-0.5B-fp16-ov
Updated
Apr 24
•
7
OpenVINO/Qwen2-0.5B-int4-ov
Updated
Apr 24
•
6
OpenVINO/Qwen2-1.5B-fp16-ov
Updated
Apr 24
•
8
OpenVINO/Qwen2-1.5B-int8-ov
Updated
Apr 24
•
7
OpenVINO/Qwen2-1.5B-int4-ov
Updated
Apr 24
•
5
OpenVINO/Qwen2-1.5B-Instruct-fp16-ov
Updated
Apr 24
•
5
OpenVINO/Qwen2-1.5B-Instruct-int8-ov
Updated
Apr 24
•
11
OpenVINO/Qwen2-7B-Instruct-fp16-ov
Updated
Apr 24
•
18
OpenVINO/Qwen2-7B-Instruct-int4-ov
Updated
Apr 24
•
1.16k
OpenVINO/Qwen2-1.5B-Instruct-int4-ov
Updated
Apr 24
•
6
OpenVINO/Qwen2-7B-Instruct-int8-ov
Updated
Apr 24
•
7
OpenVINO/Qwen3-0.6B-int4-ov
Updated
Apr 30
•
1.4k
•
2
OpenVINO/Qwen3-0.6B-fp16-ov
Updated
Apr 30
•
120
OpenVINO/Qwen3-0.6B-int8-ov
Updated
Apr 30
•
1.23k
OpenVINO/Qwen3-1.7B-fp16-ov
Updated
Apr 30
•
118
OpenVINO/Qwen3-1.7B-int8-ov
Updated
Apr 30
•
70
OpenVINO/Qwen3-1.7B-int4-ov
Updated
Apr 30
•
2
OpenVINO/Qwen3-4B-fp16-ov
Updated
Apr 30
•
61
OpenVINO/Qwen3-4B-int8-ov
Updated
Apr 30
•
72
OpenVINO/Qwen3-4B-int4-ov
Updated
May 30
•
9
OpenVINO/Qwen3-8B-fp16-ov
Updated
Apr 30
•
11
OpenVINO/Qwen3-8B-int8-ov
Updated
Apr 30
•
1.85k
OpenVINO/Qwen3-8B-int4-ov
Updated
Jun 18
•
1.64k
OpenVINO/Qwen3-14B-int8-ov
Updated
Apr 30
•
53
OpenVINO/Qwen3-14B-fp16-ov
Updated
Apr 30
•
20
OpenVINO/Qwen3-14B-int4-ov
Updated
Apr 30
•
35
OpenVINO/phi-4-fp16-ov
Text Generation
•
Updated
May 23
•
9
OpenVINO/phi-4-int8-ov
Text Generation
•
Updated
May 23
•
15
OpenVINO/phi-4-int4-ov
Text Generation
•
Updated
May 26
•
69
LLMs optimized for NPU
Collection
9 items
•
Updated
Jul 9
•
7
Upvote
41
+37
Share collection
View history
Collection guide
Browse collections