Hugging Face's logo

btbtyler09
/
cogito-v1-preview-qwen-32B-gptq-8bit

Text Generation
Transformers
Safetensors
qwen2
8bit
gptq
conversational
text-generation-inference
8-bit precision
Model card Files
xet
Community

Cogito v1 preview - 32B

GPTQ quantization of Cogito v1 preview - 32B based on Qwen QwQ. This is an 8bit gptq quantization.

Blog Post

Downloads last month
1
Safetensors
Model size
11B params
Tensor type
F16
·
I32
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for btbtyler09/cogito-v1-preview-qwen-32B-gptq-8bit

Base model

Qwen/Qwen2.5-32B
Finetuned
deepcogito/cogito-v1-preview-qwen-32B
Quantized
(21)
this model