This is the 8bit BitsAndBytes quantized version of the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct

Downloads last month
11
Safetensors
Model size
73.4B params
Tensor type
F32
BF16
I8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Maverick17/Qwen2.5-VL-72B-Instruct-bnb-8bit

Quantized
(31)
this model