Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

unsloth
/
granite-3.3-2b-instruct-GGUF

GGUF
granite
conversational
Model card Files Files and versions
xet
Community
granite-3.3-2b-instruct-GGUF
7.06 GB
  • 1 contributor
History: 2 commits
danielhanchen's picture
danielhanchen
Upload folder using huggingface_hub
5260bcd verified 5 months ago
  • .gitattributes
    2.05 kB
    Upload folder using huggingface_hub 5 months ago
  • config.json
    817 Bytes
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-IQ1_M.gguf
    658 MB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-IQ1_S.gguf
    613 MB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-IQ2_M.gguf
    908 MB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-IQ3_XXS.gguf
    1.02 GB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-Q2_K_XL.gguf
    1 GB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-Q3_K_XL.gguf
    1.29 GB
    xet
    Upload folder using huggingface_hub 5 months ago
  • granite-3.3-2b-instruct-UD-Q4_K_XL.gguf
    1.57 GB
    xet
    Upload folder using huggingface_hub 5 months ago