Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Alcoft
/
Marco-o1-GGUF
like
0
Text Generation
GGUF
English
Chinese
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
1
GGUF
Model size
7.62B params
Architecture
qwen2
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
3.02 GB
3-bit
Q3_K_S
3.49 GB
Q3_K_M
3.81 GB
Q3_K_L
4.09 GB
4-bit
Q4_K_S
4.46 GB
Q4_K_M
4.68 GB
5-bit
Q5_K_S
5.32 GB
Q5_K_M
5.44 GB
6-bit
Q6_K
6.25 GB
8-bit
Q8_0
8.1 GB
View +1 variant
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
Alcoft/Marco-o1-GGUF
Base model
AIDC-AI/Marco-o1
Quantized
(
41
)
this model
Collection including
Alcoft/Marco-o1-GGUF
TAO71-AI Quants: Other
Collection
7 items
•
Updated
14 days ago