Qwen3 irish-quant/Qwen-Qwen3-8B-8bit 3B • Updated Jul 8 • 14 irish-quant/Qwen-Qwen3-8B-2bit 2B • Updated Jul 8 • 1 irish-quant/Qwen-Qwen3-8B-3bit 2B • Updated Jul 8 • 2 irish-quant/Qwen-Qwen3-8B-4bit 2B • Updated Jul 8 • 2
Qwen1.5 irish-quant/Qwen-Qwen1.5-0.5B-Chat-2bit 0.2B • Updated Jun 11 irish-quant/Qwen-Qwen1.5-0.5B-Chat-4bit 0.2B • Updated Jun 11 • 1 irish-quant/Qwen-Qwen1.5-0.5B-Chat-3bit 0.2B • Updated Jun 11 • 1 irish-quant/Qwen-Qwen1.5-0.5B-Chat-8bit 0.2B • Updated Jun 11 • 1
Phi-3.5 irish-quant/microsoft-Phi-3.5-mini-instruct-8bit 1B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3.5-mini-instruct-2bit 0.5B • Updated Jun 11 • 2 irish-quant/microsoft-Phi-3.5-mini-instruct-4bit 0.7B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3.5-mini-instruct-3bit 0.6B • Updated Jun 11
Llama 3.2 irish-quant/meta-llama-Llama-3.2-1B-2bit 0.3B • Updated Jun 11 irish-quant/meta-llama-Llama-3.2-1B-3bit 0.4B • Updated Jun 11 irish-quant/meta-llama-Llama-3.2-1B-4bit 0.4B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.2-1B-8bit 0.5B • Updated Jun 11 • 1
Llama 3.1 irish-quant/meta-llama-Llama-3.1-8B-3bit 2B • Updated Jun 11 irish-quant/meta-llama-Llama-3.1-8B-4bit 2B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.1-8B-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.1-8B-2bit 2B • Updated Jun 11
SmolVLM irish-quant/HuggingFaceTB-SmolLM-1.7B-2bit 0.2B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit 0.3B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-4bit 0.3B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-8bit 0.5B • Updated Jun 10 • 1
Google Gemma 3 irish-quant/google-gemma-3-1b-it-4bit 0.4B • Updated Jun 12 • 4 irish-quant/google-gemma-3-1b-pt-4bit 0.4B • Updated Jun 12 • 4 irish-quant/google-gemma-3-1b-it-8bit 0.5B • Updated Jun 30 • 1 irish-quant/google-gemma-3-1b-pt-8bit 0.5B • Updated Jun 30 • 1
Yi-1.5 This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models. irish-quant/01-ai-Yi-1.5-6B-3bit 1B • Updated Jun 10 irish-quant/01-ai-Yi-1.5-6B-2bit 0.9B • Updated Jun 10 irish-quant/01-ai-Yi-1.5-6B-4bit 1B • Updated Jun 10 • 1 irish-quant/01-ai-Yi-1.5-6B-8bit 2B • Updated Jun 10 • 1
Qwen2.5 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-2bit 0.5B • Updated Jun 12 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-3bit 0.6B • Updated Jun 12 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-4bit 0.7B • Updated Jun 12 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-8bit 1B • Updated Jun 12 • 1
Mistral irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-2bit 3B • Updated Jun 11 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-3bit 4B • Updated Jun 11 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-4bit 4B • Updated Jun 11 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-8bit 7B • Updated Jun 11 • 1
Phi-3 irish-quant/microsoft-Phi-3-mini-128k-instruct-2bit 0.5B • Updated Jun 11 irish-quant/microsoft-Phi-3-mini-128k-instruct-4bit 0.7B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3-mini-128k-instruct-8bit 1B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3-mini-128k-instruct-3bit 0.6B • Updated Jun 11
Llama 3 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-2bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-4bit 2B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-3bit 2B • Updated Jun 11
Llama-Guard-2 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-2bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-3bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-4bit 2B • Updated Jun 11
Google Gemma 2 irish-quant/google-gemma-2-2b-2bit 0.7B • Updated Jun 12 irish-quant/google-gemma-2-2b-3bit 0.8B • Updated Jun 12 irish-quant/google-gemma-2-2b-4bit 0.9B • Updated Jun 12 • 1 irish-quant/google-gemma-2-2b-8bit 1B • Updated Jun 12 • 1
DeepSeek-R1-Distill irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-4bit 11B • Updated Jun 12 • 1 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-2bit 2B • Updated Jun 12 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-3bit 2B • Updated Jun 12 • 4 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-4bit 2B • Updated Jun 12 • 1
Qwen3 irish-quant/Qwen-Qwen3-8B-8bit 3B • Updated Jul 8 • 14 irish-quant/Qwen-Qwen3-8B-2bit 2B • Updated Jul 8 • 1 irish-quant/Qwen-Qwen3-8B-3bit 2B • Updated Jul 8 • 2 irish-quant/Qwen-Qwen3-8B-4bit 2B • Updated Jul 8 • 2
Qwen2.5 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-2bit 0.5B • Updated Jun 12 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-3bit 0.6B • Updated Jun 12 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-4bit 0.7B • Updated Jun 12 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-8bit 1B • Updated Jun 12 • 1
Qwen1.5 irish-quant/Qwen-Qwen1.5-0.5B-Chat-2bit 0.2B • Updated Jun 11 irish-quant/Qwen-Qwen1.5-0.5B-Chat-4bit 0.2B • Updated Jun 11 • 1 irish-quant/Qwen-Qwen1.5-0.5B-Chat-3bit 0.2B • Updated Jun 11 • 1 irish-quant/Qwen-Qwen1.5-0.5B-Chat-8bit 0.2B • Updated Jun 11 • 1
Mistral irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-2bit 3B • Updated Jun 11 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-3bit 4B • Updated Jun 11 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-4bit 4B • Updated Jun 11 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-8bit 7B • Updated Jun 11 • 1
Phi-3.5 irish-quant/microsoft-Phi-3.5-mini-instruct-8bit 1B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3.5-mini-instruct-2bit 0.5B • Updated Jun 11 • 2 irish-quant/microsoft-Phi-3.5-mini-instruct-4bit 0.7B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3.5-mini-instruct-3bit 0.6B • Updated Jun 11
Phi-3 irish-quant/microsoft-Phi-3-mini-128k-instruct-2bit 0.5B • Updated Jun 11 irish-quant/microsoft-Phi-3-mini-128k-instruct-4bit 0.7B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3-mini-128k-instruct-8bit 1B • Updated Jun 11 • 1 irish-quant/microsoft-Phi-3-mini-128k-instruct-3bit 0.6B • Updated Jun 11
Llama 3.2 irish-quant/meta-llama-Llama-3.2-1B-2bit 0.3B • Updated Jun 11 irish-quant/meta-llama-Llama-3.2-1B-3bit 0.4B • Updated Jun 11 irish-quant/meta-llama-Llama-3.2-1B-4bit 0.4B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.2-1B-8bit 0.5B • Updated Jun 11 • 1
Llama 3 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-2bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-4bit 2B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-3bit 2B • Updated Jun 11
Llama 3.1 irish-quant/meta-llama-Llama-3.1-8B-3bit 2B • Updated Jun 11 irish-quant/meta-llama-Llama-3.1-8B-4bit 2B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.1-8B-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Llama-3.1-8B-2bit 2B • Updated Jun 11
Llama-Guard-2 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-2bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-3bit 2B • Updated Jun 11 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-8bit 3B • Updated Jun 11 • 1 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-4bit 2B • Updated Jun 11
SmolVLM irish-quant/HuggingFaceTB-SmolLM-1.7B-2bit 0.2B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit 0.3B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-4bit 0.3B • Updated Jun 10 irish-quant/HuggingFaceTB-SmolLM-1.7B-8bit 0.5B • Updated Jun 10 • 1
Google Gemma 2 irish-quant/google-gemma-2-2b-2bit 0.7B • Updated Jun 12 irish-quant/google-gemma-2-2b-3bit 0.8B • Updated Jun 12 irish-quant/google-gemma-2-2b-4bit 0.9B • Updated Jun 12 • 1 irish-quant/google-gemma-2-2b-8bit 1B • Updated Jun 12 • 1
Google Gemma 3 irish-quant/google-gemma-3-1b-it-4bit 0.4B • Updated Jun 12 • 4 irish-quant/google-gemma-3-1b-pt-4bit 0.4B • Updated Jun 12 • 4 irish-quant/google-gemma-3-1b-it-8bit 0.5B • Updated Jun 30 • 1 irish-quant/google-gemma-3-1b-pt-8bit 0.5B • Updated Jun 30 • 1
DeepSeek-R1-Distill irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-4bit 11B • Updated Jun 12 • 1 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-2bit 2B • Updated Jun 12 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-3bit 2B • Updated Jun 12 • 4 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-4bit 2B • Updated Jun 12 • 1
Yi-1.5 This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models. irish-quant/01-ai-Yi-1.5-6B-3bit 1B • Updated Jun 10 irish-quant/01-ai-Yi-1.5-6B-2bit 0.9B • Updated Jun 10 irish-quant/01-ai-Yi-1.5-6B-4bit 1B • Updated Jun 10 • 1 irish-quant/01-ai-Yi-1.5-6B-8bit 2B • Updated Jun 10 • 1
