ISTA-DASLab
/

Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (0)

it run on colab t4

#5 opened 12 months ago by

Need example of model usage

#4 opened about 1 year ago by

gguf

#3 opened about 1 year ago by

VLLM error

#2 opened about 1 year ago by

The quant doesn't load in vLLM / Aphrodite Engine

#1 opened about 1 year ago by