GPTQ or AWQ Quants
#12
by
guialfaro
- opened
Are there any GPTQ or AWQ available?
You can use llama.cpp to run the gguf quantization of the model.
Are there any GPTQ or AWQ available?
You can use llama.cpp to run the gguf quantization of the model.