EXL3 models
Collection
36 items
•
Updated
•
38
EXL3 quants of Qwen3-VL-32B-Instruct
⚠️ Requires ExLlamaV3 v0.0.13 (or v0.0.12 dev branch)
2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
SVG Catbench
2.00 bpw
|
2.25 bpw
|
2.5 bpw
|
3.00 bpw
|
3.50 bpw
|
4.00 bpw
|
5.00 bpw
|
6.00 bpw
|
API
|
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for turboderp/Qwen3-VL-32B-Instruct-exl3
Base model
Qwen/Qwen3-VL-32B-Instruct