Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Phi-4-mini-instruct.gguf
like
25
Text Generation
GGUF
Demo
Phi 4 Mini
multilingual
reasoning
code generation
function calling
chat completion
memory efficient
low latency
128k context
imatrix
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
280f29d
Phi-4-mini-instruct.gguf
Ctrl+K
Ctrl+K
1 contributor
History:
43 commits
Mungert
Upload phi-4-mini.imatrix with huggingface_hub
280f29d
verified
4 months ago
.gitattributes
2.8 kB
Upload phi-4-mini.imatrix with huggingface_hub
4 months ago
README.md
5.31 kB
Update README.md
4 months ago
phi-4-mini-bf16-q8.gguf
4.66 GB
xet
Upload phi-4-mini-bf16-q8.gguf with huggingface_hub
4 months ago
phi-4-mini-bf16.gguf
7.68 GB
xet
Upload phi-4-mini-bf16.gguf with huggingface_hub
4 months ago
phi-4-mini-f16-q8.gguf
4.66 GB
xet
Upload phi-4-mini-f16-q8.gguf with huggingface_hub
4 months ago
phi-4-mini-f16.gguf
7.68 GB
xet
Upload phi-4-mini-f16.gguf with huggingface_hub
4 months ago
phi-4-mini-iq4_xs.gguf
2.22 GB
xet
Upload phi-4-mini-iq4_xs.gguf with huggingface_hub
4 months ago
phi-4-mini-q3_k_l.gguf
2.27 GB
xet
Upload phi-4-mini-q3_k_l.gguf with huggingface_hub
4 months ago
phi-4-mini-q3_k_m.gguf
2.12 GB
xet
Upload phi-4-mini-q3_k_m.gguf with huggingface_hub
4 months ago
phi-4-mini-q3_k_s.gguf
1.9 GB
xet
Upload phi-4-mini-q3_k_s.gguf with huggingface_hub
4 months ago
phi-4-mini-q4_0.gguf
2.17 GB
xet
Upload phi-4-mini-q4_0.gguf with huggingface_hub
4 months ago
phi-4-mini-q4_1.gguf
2.41 GB
xet
Upload phi-4-mini-q4_1.gguf with huggingface_hub
4 months ago
phi-4-mini-q4_k_l.gguf
2.64 GB
xet
Upload phi-4-mini-q4_k_l.gguf with huggingface_hub
4 months ago
phi-4-mini-q4_k_m.gguf
2.49 GB
xet
Upload phi-4-mini-q4_k_m.gguf with huggingface_hub
4 months ago
phi-4-mini-q4_k_s.gguf
2.34 GB
xet
Upload phi-4-mini-q4_k_s.gguf with huggingface_hub
4 months ago
phi-4-mini-q5_k_l.gguf
3 GB
xet
Upload phi-4-mini-q5_k_l.gguf with huggingface_hub
4 months ago
phi-4-mini-q5_k_m.gguf
2.85 GB
xet
Upload phi-4-mini-q5_k_m.gguf with huggingface_hub
4 months ago
phi-4-mini-q5_k_s.gguf
2.73 GB
xet
Upload phi-4-mini-q5_k_s.gguf with huggingface_hub
4 months ago
phi-4-mini-q6_k_l.gguf
3.3 GB
xet
Upload phi-4-mini-q6_k_l.gguf with huggingface_hub
4 months ago
phi-4-mini-q6_k_m.gguf
3.16 GB
xet
Upload phi-4-mini-q6_k_m.gguf with huggingface_hub
4 months ago
phi-4-mini-q8.gguf
4.08 GB
xet
Upload phi-4-mini-q8.gguf with huggingface_hub
4 months ago
phi-4-mini.imatrix
Safe
2.23 MB
xet
Upload phi-4-mini.imatrix with huggingface_hub
4 months ago