AWQ Quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B
AWQ quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B using AutoAWQ for quantization.
Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 128.
- Downloads last month
- 66
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support
Model tree for ArtusDev/nbeerbower_EVA-abliterated-TIES-Qwen2.5-72B-AWQ
Base model
nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B