Hugging Face's logo

digitous
/
13B-HyperMantis_GPTQ_4bit-128g

Text Generation
Transformers
llama
alpaca
mix
gptq
quant
Inference Endpoints
Model card Files Community

GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis

Downloads last month
42
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Space using digitous/13B-HyperMantis_GPTQ_4bit-128g 1