allura-quants/Q3-30b-A3b-Pentiment-W4G128-GPTQ-gptqmodel
Updated
•
11
Q3 30b A3b Pentiment - GPTQ
GPTQ quants made with both GPTQModel and Autoround (PSA, may not work ootb in vLLM --- working on it)