GGUF
community
AI & ML interests
Our goal is to simplify the process of searching for and exchanging quantized models in GGUF format, as well as to create a space for efficient exchange and access to the models you need
Recent Activity
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 8 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 210 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 14 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 23 • 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 5 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 3 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 2 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 4 • 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation • 9B • Updated • 5 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation • 9B • Updated • 3 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation • 9B • Updated • 5 • 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation • 9B • Updated • 6
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 3 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 4
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 21 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 2 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 19 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 5
-
matrixportal/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 23 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation • 15B • Updated • 10 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated • 26 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 19
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation • 8B • Updated • 3 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 10 • 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated • 8 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B • Updated • 20
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 8 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 210 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 14 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 23 • 1
-
matrixportal/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 23 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation • 15B • Updated • 10 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated • 26 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 19
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 5 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 3 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 2 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 4 • 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation • 9B • Updated • 5 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation • 9B • Updated • 3 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation • 9B • Updated • 5 • 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation • 9B • Updated • 6
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation • 8B • Updated • 3 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 10 • 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated • 8 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B • Updated • 20
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 3 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 4
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 21 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 2 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 19 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 5