Hugging Face's logo

unsloth
/
orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech
Transformers
Safetensors
English
llama
text-generation
text-generation-inference
4-bit precision
bitsandbytes
Model card Files
xet
Community
1
New discussion

run with "vllm serve" comes to an error: KeyError: 'layers.0.mlp.down_proj.weight.absmax'

2
#1 opened about 1 month ago by
ly0303521