Hugging Face's logo

bigquant
/
Senku-70B-AWQ-4bit-GEMM

Text Generation
Transformers
Safetensors
llama
AWQ
Miqu
Senku
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community
1
New discussion

Seems to output gibberish when used in vllm. Not sure what I'm doing wrong.

1
#1 opened over 1 year ago by
Nero10578