GGUFs for Qwen 1.5 32B - https://huggingface.co/Qwen/Qwen1.5-32B

This is the vanilla non chat version of the model.

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Files >50gb have been split with peazip. Recombine with peazip, 7zip, or simple concatenate command.

Downloads last month
7
GGUF
Model size
32.5B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support