Hugging Face's logo

ibm-granite
/
granite-3.3-2b-instruct-GGUF

Text Generation
Transformers
GGUF
language
granite-3.3
conversational
Model card Files Community

This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-2b-instruct

Downloads last month
909
GGUF
Model size
2.53B params
Architecture
granite
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ibm-granite/granite-3.3-2b-instruct-GGUF

Base model

ibm-granite/granite-3.3-2b-base
Finetuned
ibm-granite/granite-3.3-2b-instruct
Quantized
(22)
this model

Collection including ibm-granite/granite-3.3-2b-instruct-GGUF