alpindale
/

c4ai-command-r-plus-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (2)

Can you provide command-a 2025 gptq？

#9 opened 26 days ago by

Please provide onnx model along with inference script.

#7 opened 5 months ago by

VRAM requirement

#5 opened about 1 year ago by

Can VLLM be used for loading?

#4 opened about 1 year ago by

How many bits and what is the groupsize?

#3 opened about 1 year ago by

What library was used to quantize the model?

#2 opened about 1 year ago by

How to load command r+ in text-generation-webui?

#1 opened about 1 year ago by

MLDataScientist