Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
text-generation-inference
Model card Files Community
15
New discussion

That wizardlm 8x22b is very advanced.!

10
18
#8 opened about 1 year ago by
mirek190

Help regarding best quantization for below PC specification.

6
#15 opened about 1 year ago by
bikkikumarsha

AWQ and GPTQ plz

4
6
#11 opened about 1 year ago by
Parkerlambert123