Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
unsloth
/
granite-3.3-8b-instruct-GGUF
like
7
Follow
Unsloth AI
9.89k
Text Generation
Transformers
GGUF
granite
language
unsloth
granite-3.3
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
0b21a03
granite-3.3-8b-instruct-GGUF
74.9 GB
1 contributor
History:
4 commits
danielhanchen
Upload folder using huggingface_hub
0b21a03
verified
5 months ago
.gitattributes
2.91 kB
Upload folder using huggingface_hub
5 months ago
README.md
Safe
27.6 kB
Upload folder using huggingface_hub
5 months ago
config.json
Safe
820 Bytes
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-IQ4_NL.gguf
Safe
4.67 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-IQ4_XS.gguf
Safe
4.43 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q2_K.gguf
Safe
3.1 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q2_K_L.gguf
Safe
3.1 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q3_K_M.gguf
Safe
4 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q3_K_S.gguf
Safe
3.59 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q4_0.gguf
Safe
4.67 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q4_1.gguf
Safe
5.15 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q4_K_M.gguf
Safe
4.94 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q5_K_M.gguf
Safe
5.8 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-Q6_K.gguf
Safe
6.71 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-IQ1_M.gguf
Safe
2.07 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-IQ1_S.gguf
Safe
1.93 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-IQ2_M.gguf
Safe
2.89 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-IQ2_XXS.gguf
Safe
2.32 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-IQ3_XXS.gguf
Safe
3.24 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-Q2_K_XL.gguf
Safe
3.18 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-Q3_K_XL.gguf
Safe
4.1 GB
xet
Upload folder using huggingface_hub
5 months ago
granite-3.3-8b-instruct-UD-Q4_K_XL.gguf
Safe
5.04 GB
xet
Upload folder using huggingface_hub
5 months ago
