Hugging Face's logo

MaziyarPanahi
/
Mistral-7B-Instruct-v0.3-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Inference Endpoints
text-generation-inference
imatrix
Model card Files Community
10
New discussion

Interview request: genAI evaluation & documentation
#10 opened 2 months ago by meggymuggy

Add memory usage of each Quantization Methods
#9 opened 4 months ago by ar08

cant deploy on inference endpoint

3
#8 opened 4 months ago by goporo

Support for Function Calling?

1
#6 opened 5 months ago by darniss

OSError: MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

1
#5 opened 5 months ago by orby

v3 tokenizer

4
#4 opened 6 months ago by ayyylol

Can you please also quantize Phi-3-SMALL!!!

5
#2 opened 6 months ago by alexcardo