Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-3.1-8B-Instruct-GGUF
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
114
GGUF
llama
quantized
gptq
evopress
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Llama-3.1-8B-Instruct-GGUF
38.3 GB
1 contributor
History:
14 commits
helcig
Update README.md
ac11b29
verified
26 days ago
.gitattributes
Safe
2.13 kB
Upload /Llama-3.1-8B-Instruct-GPTQ-Q6_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q3_K.gguf
Safe
3.84 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q3_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q4_K.gguf
Safe
4.73 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q4_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q5_K.gguf
Safe
5.61 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-EvoPress-Q5_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-Q2_K.gguf
Safe
3.16 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-Q2_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-Q3_K.gguf
Safe
3.87 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-Q3_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-Q4_K.gguf
Safe
4.8 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-Q4_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-Q5_K.gguf
Safe
5.67 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-Q5_K.gguf with huggingface_hub
26 days ago
Llama-3.1-8B-Instruct-GPTQ-Q6_K.gguf
Safe
6.6 GB
xet
Upload /Llama-3.1-8B-Instruct-GPTQ-Q6_K.gguf with huggingface_hub
26 days ago
README.md
Safe
1.18 kB
Update README.md
26 days ago
