brunopio
/

Qwen2.5-7B-Instruct-1M-nbits4-GS64-Axis1-HQQ-T

8-bit precision

Model card Files Files and versions Community

Use the latest transformers for this model.

Downloads last month: 11

Safetensors

Model size

4.56B params

Tensor type

FP16

·

I64

·

U8

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for brunopio/Qwen2.5-7B-Instruct-1M-nbits4-GS64-Axis1-HQQ-T

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-7B-Instruct-1M

Quantized

(69)

this model