DevQuasar
/

ibm-granite.granite-guardian-3.2-5b-GGUF

Text Generation

Model card Files Files and versions

ibm-granite.granite-guardian-3.2-5b-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 11 commits

csabakecskemeti's picture

csabakecskemeti

Upload ibm-granite.granite-guardian-3.2-5b.Q3_K_L.gguf with huggingface_hub

277880a verified 4 months ago

.gitattributes

2.27 kB

Upload ibm-granite.granite-guardian-3.2-5b.Q3_K_L.gguf with huggingface_hub 4 months ago
README.md

862 Bytes

Upload README.md with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q2_K.gguf

2.22 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q2_K.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q3_K_L.gguf

3.09 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q3_K_L.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q3_K_M.gguf

2.85 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q3_K_M.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q3_K_S.gguf

2.56 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q3_K_S.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q4_K_M.gguf

3.51 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q4_K_M.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q5_K_M.gguf

4.11 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q5_K_M.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q6_K.gguf

4.74 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q6_K.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.Q8_0.gguf

6.14 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.Q8_0.gguf with huggingface_hub 4 months ago
ibm-granite.granite-guardian-3.2-5b.f16.gguf

11.6 GB
xet

Upload ibm-granite.granite-guardian-3.2-5b.f16.gguf with huggingface_hub 4 months ago