Qwen
/

Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (2)

some weights not initialized problem with transformers library.

#13 opened 3 months ago by

Update README.md

#12 opened 3 months ago by

(vLLM) Tool calling broken after update to tokenizer_config.json

#10 opened 3 months ago by

RuntimeError: expected mat1 and mat2 to have the same dtype, but got: struct c10::Half != struct c10::BFloat16

#9 opened 4 months ago by

AssertionError: Both operands must be same dtype. Got fp16 and bf16

#8 opened 4 months ago by

can it work on single 3090?

#7 opened 4 months ago by

Model does not produce meaningful output for VQA

#6 opened 4 months ago by

The inference speed of the AWQ model is slower than that of the original model

#4 opened 4 months ago by

Quality issues with AWQ Model

#3 opened 4 months ago by

Should have a `image_processor_type` key

#2 opened 4 months ago by

Unrecognized image processor in Qwen/Qwen2.5-VL-32B-Instruct-AWQ.

#1 opened 4 months ago by