Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Alcoft
/
SmolLM2-1.7B-Instruct-GGUF
like
0
Text Generation
GGUF
English
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
43
GGUF
Model size
1.71B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
675 MB
3-bit
Q3_K_S
777 MB
Q3_K_M
860 MB
Q3_K_L
933 MB
4-bit
Q4_K_S
999 MB
Q4_K_M
1.06 GB
5-bit
Q5_K_S
1.19 GB
Q5_K_M
1.23 GB
6-bit
Q6_K
1.41 GB
8-bit
Q8_0
1.82 GB
16-bit
F16
3.42 GB
BF16
3.42 GB
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for
Alcoft/SmolLM2-1.7B-Instruct-GGUF
Base model
HuggingFaceTB/SmolLM2-1.7B
Quantized
HuggingFaceTB/SmolLM2-1.7B-Instruct
Quantized
(
83
)
this model
Collection including
Alcoft/SmolLM2-1.7B-Instruct-GGUF
TAO71-AI Quants: SmolLM2
Collection
3 items
โข
Updated
14 days ago