TheBloke
/

vicuna-7B-v0-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

GPTQ Compatibility Issues with WebUI

#3 opened about 2 years ago by

RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM

#2 opened about 2 years ago by