Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Phi-4-mini-instruct.gguf
like
13
Text Generation
GGUF
Phi
Phi-4
Inference Endpoints
imatrix
conversational
License:
mit
Model card
Files
Files and versions
Community
1
Deploy
Use this model
main
Phi-4-mini-instruct.gguf
1 contributor
History:
75 commits
Mungert
Update README.md
13e1719
verified
about 7 hours ago
.gitattributes
Safe
2.98 kB
Upload phi-4-mini-q2_k_l.gguf with huggingface_hub
about 17 hours ago
README.md
Safe
7.36 kB
Update README.md
about 7 hours ago
phi-4-mini-bf16-q8.gguf
Safe
4.66 GB
LFS
Upload phi-4-mini-bf16-q8.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-bf16.gguf
Safe
7.68 GB
LFS
Upload phi-4-mini-bf16.gguf with huggingface_hub
about 9 hours ago
phi-4-mini-f16-q8.gguf
Safe
4.66 GB
LFS
Upload phi-4-mini-f16-q8.gguf with huggingface_hub
about 9 hours ago
phi-4-mini-f16.gguf
Safe
7.68 GB
LFS
Upload phi-4-mini-f16.gguf with huggingface_hub
about 20 hours ago
phi-4-mini-iq2_m.gguf
Safe
1.51 GB
LFS
Upload phi-4-mini-iq2_m.gguf with huggingface_hub
about 18 hours ago
phi-4-mini-iq3_xs.gguf
Safe
1.84 GB
LFS
Upload phi-4-mini-iq3_xs.gguf with huggingface_hub
about 7 hours ago
phi-4-mini-iq4_nl.gguf
Safe
2.33 GB
LFS
Upload phi-4-mini-iq4_nl.gguf with huggingface_hub
about 7 hours ago
phi-4-mini-iq4_xs.gguf
Safe
2.22 GB
LFS
Upload phi-4-mini-iq4_xs.gguf with huggingface_hub
about 7 hours ago
phi-4-mini-q2_k_l.gguf
Safe
1.83 GB
LFS
Upload phi-4-mini-q2_k_l.gguf with huggingface_hub
about 7 hours ago
phi-4-mini-q3_k_l.gguf
Safe
2.27 GB
LFS
Upload phi-4-mini-q3_k_l.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q3_k_m.gguf
Safe
2.12 GB
LFS
Upload phi-4-mini-q3_k_m.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q3_k_s.gguf
Safe
1.9 GB
LFS
Upload phi-4-mini-q3_k_s.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q4_0.gguf
Safe
2.17 GB
LFS
Upload phi-4-mini-q4_0.gguf with huggingface_hub
about 18 hours ago
phi-4-mini-q4_1.gguf
Safe
2.41 GB
LFS
Upload phi-4-mini-q4_1.gguf with huggingface_hub
about 18 hours ago
phi-4-mini-q4_k_l.gguf
Safe
2.64 GB
LFS
Upload phi-4-mini-q4_k_l.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q4_k_m.gguf
Safe
2.49 GB
LFS
Upload phi-4-mini-q4_k_m.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q4_k_s.gguf
Safe
2.34 GB
LFS
Upload phi-4-mini-q4_k_s.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q5_k_l.gguf
Safe
3 GB
LFS
Upload phi-4-mini-q5_k_l.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q5_k_m.gguf
Safe
2.85 GB
LFS
Upload phi-4-mini-q5_k_m.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q5_k_s.gguf
Safe
2.73 GB
LFS
Upload phi-4-mini-q5_k_s.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q6_k_l.gguf
Safe
3.3 GB
LFS
Upload phi-4-mini-q6_k_l.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q6_k_m.gguf
Safe
3.16 GB
LFS
Upload phi-4-mini-q6_k_m.gguf with huggingface_hub
about 8 hours ago
phi-4-mini-q8.gguf
Safe
4.08 GB
LFS
Upload phi-4-mini-q8.gguf with huggingface_hub
about 8 hours ago
phi-4-mini.imatrix
Safe
2.23 MB
LFS
Upload phi-4-mini.imatrix with huggingface_hub
about 18 hours ago
