Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-NeMo-Minitron-8B-Instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
b7695fd
Mistral-NeMo-Minitron-8B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
MaziyarPanahi
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
b7695fd
verified
6 months ago
.gitattributes
1.84 kB
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
6 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_M.gguf
Safe
6 GB
LFS
849ab006c1ea3adfd33a8c36f15215a3b4b128d98cf4ed8ee3ad1d2abfff5bde
6 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_S.gguf
Safe
5.86 GB
LFS
5157a8b4ffdae7a7c61cb6fa83b672146adc05887538b53d1f35e7ebfacd7e60
6 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q6_K.gguf
Safe
6.91 GB
LFS
537569048ef565b3d1fb161305888ea12f5440b446fd8daad782cd2eb7ba4a01
6 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q8_0.gguf
Safe
8.95 GB
LFS
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
6 months ago