maderix
/

llama-65b-4bit

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (1)

This is a v1 model. Doesn't run on newer GPTQ anymore.

#6 opened almost 2 years ago by

ggml_alpaca_30b_q4 ?

#5 opened almost 2 years ago by

config.json

#4 opened almost 2 years ago by

Example of how to use the models

#3 opened almost 2 years ago by

What was the conversion process?

#2 opened almost 2 years ago by