QuantTrio
/

Qwen3-235B-A22B-Thinking-2507-GPTQ-Int4-Int8Mix

Text Generation

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Upgrade to 1m context

#4 opened 11 days ago by

Help: Trying to load on 2x 6000 pro 96gb

#3 opened 21 days ago by

Failed with v0.9.2 on 8x2080Ti 22GB

#2 opened 25 days ago by

Unable to load with vllm, "model.safetensors.index.json" contains incorrect files.

#1 opened 28 days ago by