Smol Quantized - a BjornMelin Collection

BjornMelin 's Collections

Courses & Certifications

Single 4090 Laptop GPU

Mistral

Legendary VL Models

Google

Llama

Qwen

LLMs

Smol Quantized

updated Apr 19

My favorite quantized models under 10B parameters.

bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • 15B • Updated Mar 10 • 27.2k • 210
bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 1.72k • 29
bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 4.93k • 30
bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Oct 8, 2024 • 298k • 151
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 194k • 20
bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 6.45k • 31
bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • 4B • Updated Oct 26, 2024 • 12.8k • 63
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Mar 7 • 13.9k • 99
bartowski/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • 8B • Updated Jan 22 • 6.91k • 48
microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated May 1 • 9.63k • 1.13k
microsoft/bitnet-b1.58-2B-4T-gguf

Text Generation • 2B • Updated May 1 • 11.1k • 188