ig1
/

Qwen2.5-72B-Instruct-FP8-Dynamic

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

FP8 activation quantization performed with llm-compressor

Downloads last month: 73

Safetensors

Model size

72.7B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Model tree for ig1/Qwen2.5-72B-Instruct-FP8-Dynamic

Base model

Qwen/Qwen2.5-72B

Finetuned

Qwen/Qwen2.5-72B-Instruct

Quantized

(79)

this model