Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
legraphista
/
RoLlama3-8b-Instruct-IMat-GGUF
like
3
Text Generation
GGUF
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card
Files
Files and versions
xet
Community
Use this model
1a70a70
RoLlama3-8b-Instruct-IMat-GGUF
47.5 GB
1 contributor
History:
16 commits
legraphista
Upload RoLlama3-8b-Instruct.Q4_K.gguf with huggingface_hub
1a70a70
verified
over 1 year ago
.gitattributes
1.97 kB
Upload RoLlama3-8b-Instruct.Q4_K.gguf with huggingface_hub
over 1 year ago
README.md
7.52 kB
Upload README.md with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.BF16.gguf
Safe
16.1 GB
xet
Upload RoLlama3-8b-Instruct.BF16.gguf with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.Q4_K.gguf
Safe
4.92 GB
xet
Upload RoLlama3-8b-Instruct.Q4_K.gguf with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.Q5_K.gguf
Safe
5.73 GB
xet
Upload RoLlama3-8b-Instruct.Q5_K.gguf with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.Q5_K_S.gguf
Safe
5.6 GB
xet
Upload RoLlama3-8b-Instruct.Q5_K_S.gguf with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.Q6_K.gguf
Safe
6.6 GB
xet
Upload RoLlama3-8b-Instruct.Q6_K.gguf with huggingface_hub
over 1 year ago
RoLlama3-8b-Instruct.Q8_0.gguf
Safe
8.54 GB
xet
Upload RoLlama3-8b-Instruct.Q8_0.gguf with huggingface_hub
over 1 year ago
imatrix.dat
4.99 MB
xet
Upload imatrix.dat with huggingface_hub
over 1 year ago
imatrix.dataset
Safe
280 kB
Upload imatrix.dataset with huggingface_hub
over 1 year ago
imatrix.log
Safe
10.2 kB
Upload imatrix.log with huggingface_hub
over 1 year ago
