ig1
/

Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text

text-generation-inference

compressed-tensors

Model card Files Files and versions Community

FP8 activation quantization performed with llm-compressor

Downloads last month: 93

Safetensors

Model size

8.29B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

Image-Text-to-Text

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ig1/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Base model

Qwen/Qwen2.5-VL-7B-Instruct

Quantized

(38)

this model