A collection of quantized models. All the models can be fine-tuned by adding a LoRA Adapter.
-
shuyuej/Command-R-Plus-GPTQ
Text Generation • 104B • Updated • 9 • 1 -
shuyuej/Meta-Llama-3-8B-Instruct-GPTQ
Text Generation • 8B • Updated • 6 • 1 -
shuyuej/Command-R-GPTQ
Text Generation • 37B • Updated • 7 • 1 -
shuyuej/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation • 71B • Updated • 8