Mungert/Phi-4-mini-instruct.gguf at bf16f8c196313df4f5409233bda48d28f2386d2f

Phi-4-mini-instruct.gguf

Ctrl+K

Ctrl+K

1 contributor

History: 126 commits

Mungert's picture

Upload phi-4-mini-q6_k_m.gguf with huggingface_hub

bf16f8c verified 4 months ago

.gitattributes

3.03 kB

Upload phi-4-mini-q2_k_m.gguf with huggingface_hub 4 months ago
README.md

10 kB

Update README.md 4 months ago
phi-4-mini-bf16-q8.gguf

4.66 GB
xet

Upload phi-4-mini-bf16-q8.gguf with huggingface_hub 4 months ago
phi-4-mini-bf16.gguf

7.68 GB
xet

Upload phi-4-mini-bf16.gguf with huggingface_hub 4 months ago
phi-4-mini-f16-q8.gguf

4.66 GB
xet

Upload phi-4-mini-f16-q8.gguf with huggingface_hub 4 months ago
phi-4-mini-f16.gguf

7.68 GB
xet

Upload phi-4-mini-f16.gguf with huggingface_hub 4 months ago
phi-4-mini-iq2_m.gguf

1.51 GB
xet

Upload phi-4-mini-iq2_m.gguf with huggingface_hub 4 months ago
phi-4-mini-iq3_xs.gguf

1.84 GB
xet

Upload phi-4-mini-iq3_xs.gguf with huggingface_hub 4 months ago
phi-4-mini-iq4_nl.gguf

2.33 GB
xet

Upload phi-4-mini-iq4_nl.gguf with huggingface_hub 4 months ago
phi-4-mini-iq4_xs.gguf

2.22 GB
xet

Upload phi-4-mini-iq4_xs.gguf with huggingface_hub 4 months ago
phi-4-mini-q2_k_l.gguf

1.83 GB
xet

Upload phi-4-mini-q2_k_l.gguf with huggingface_hub 4 months ago
phi-4-mini-q2_k_m.gguf

1.68 GB
xet

Upload phi-4-mini-q2_k_m.gguf with huggingface_hub 4 months ago
phi-4-mini-q3_k_l.gguf

2.27 GB
xet

Upload phi-4-mini-q3_k_l.gguf with huggingface_hub 4 months ago
phi-4-mini-q3_k_m.gguf

2.12 GB
xet

Upload phi-4-mini-q3_k_m.gguf with huggingface_hub 4 months ago
phi-4-mini-q3_k_s.gguf

1.9 GB
xet

Upload phi-4-mini-q3_k_s.gguf with huggingface_hub 4 months ago
phi-4-mini-q4_0.gguf

2.47 GB
xet

Upload phi-4-mini-q4_0.gguf with huggingface_hub 4 months ago
phi-4-mini-q4_1.gguf

2.68 GB
xet

Upload phi-4-mini-q4_1.gguf with huggingface_hub 4 months ago
phi-4-mini-q4_k_l.gguf

2.64 GB
xet

Upload phi-4-mini-q4_k_l.gguf with huggingface_hub 4 months ago
phi-4-mini-q4_k_m.gguf

2.49 GB
xet

Upload phi-4-mini-q4_k_m.gguf with huggingface_hub 4 months ago
phi-4-mini-q4_k_s.gguf

2.34 GB
xet

Upload phi-4-mini-q4_k_s.gguf with huggingface_hub 4 months ago
phi-4-mini-q5_k_l.gguf

3 GB
xet

Upload phi-4-mini-q5_k_l.gguf with huggingface_hub 4 months ago
phi-4-mini-q5_k_m.gguf

2.85 GB
xet

Upload phi-4-mini-q5_k_m.gguf with huggingface_hub 4 months ago
phi-4-mini-q5_k_s.gguf

2.73 GB
xet

Upload phi-4-mini-q5_k_s.gguf with huggingface_hub 4 months ago
phi-4-mini-q6_k_l.gguf

3.3 GB
xet

Upload phi-4-mini-q6_k_l.gguf with huggingface_hub 4 months ago
phi-4-mini-q6_k_m.gguf

3.16 GB
xet

Upload phi-4-mini-q6_k_m.gguf with huggingface_hub 4 months ago
phi-4-mini-q8.gguf

4.08 GB
xet

Upload phi-4-mini-q8.gguf with huggingface_hub 4 months ago
phi-4-mini.imatrix

2.23 MB
xet

Upload phi-4-mini.imatrix with huggingface_hub 4 months ago