Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ruslanmv
/
granite-3.1-8b-Reasoning-GGUF
like
0
Text Generation
Transformers
GGUF
English
granite
english
text-generation-inference
inference-endpoints
conversational
4-bit precision
5-bit
8-bit precision
ruslanmv
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
granite-3.1-8b-Reasoning-GGUF
1 contributor
History:
7 commits
ruslanmv
Update README.md
51a569a
verified
10 days ago
.gitattributes
1.69 kB
(Trained with Unsloth)
10 days ago
README.md
3.75 kB
Update README.md
10 days ago
config.json
31 Bytes
(Trained with Unsloth)
10 days ago
unsloth.Q4_K_M.gguf
4.94 GB
LFS
(Trained with Unsloth)
10 days ago
unsloth.Q5_K_M.gguf
5.8 GB
LFS
(Trained with Unsloth)
10 days ago
unsloth.Q8_0.gguf
8.68 GB
LFS
(Trained with Unsloth)
10 days ago