Hugging Face's logo

unsloth
/
Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
multimodal
qwen
qwen2
unsloth
vision
conversational
text-generation-inference
4-bit precision
bitsandbytes
Model card Files
xet
Community
4

Can you gives the inference code?

#4
by LukeJacob2023 - opened
Discussion
LukeJacob2023

as the title

shimmyshimmer
 Unsloth AI org

as the title

For vLLM or? You'll need to look through vLLM github issues or docs.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment