Nvidia AWQs + GPTQs
Collection
5 items
•
Updated
OpenCodeReasoning-Nemotron-1.1-32B-AWQ
Method
Quantised using casper-hansen/AutoAWQ and the following configs:
quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
- Downloads last month
- 61
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for cpatonn/OpenCodeReasoning-Nemotron-1.1-32B-AWQ
Base model
Qwen/Qwen2.5-32B
Finetuned
Qwen/Qwen2.5-32B-Instruct