Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,989

Full-text search

Active filters: 2-bit

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated Feb 16 • 189 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-16k-GGUF

Text Generation • Updated Feb 21 • 79 • 1

MaziyarPanahi/ALLaM-7B-Instruct-preview-reasoning-GGUF

Text Generation • Updated Feb 21 • 310 • 1

MaziyarPanahi/Lamarck-14B-v0.7-Fusion-GGUF

Text Generation • Updated Feb 23 • 434 • 1

MaziyarPanahi/Viper-Coder-HybridMini-v1.3-GGUF

Text Generation • Updated Feb 23 • 325 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • Updated Feb 24 • 1.03k • 1

mlx-community/perplexity-ai-r1-1776-2bit

Updated Feb 25 • 28 • 1

kaitchup/Qwen2.5-72B-Instruct-AutoRoundGPTQ-2bit

Text Generation • Updated Feb 26 • 21 • 1

MaziyarPanahi/Primal-Opus-14B-Optimus-v2-GGUF

Text Generation • Updated 30 days ago • 246 • 1

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • Updated 30 days ago • 1.17M • 4

kaitchup/QwQ-32B-AutoRoundGPTQ-2bit

Text Generation • Updated 24 days ago • 48 • 1

MaziyarPanahi/Qwen-1M-DeepSeek-R1-14B-GGUF

Text Generation • Updated 23 days ago • 404 • 1

MaziyarPanahi/gemma-2-2b-fa-v2-GGUF

Text Generation • Updated 21 days ago • 235 • 1

MaziyarPanahi/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

Text Generation • Updated 20 days ago • 207 • 1

MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF

Text Generation • Updated 20 days ago • 367 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated 20 days ago • 417 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated 20 days ago • 430 • 1

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated 18 days ago • 651k • 2

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated 18 days ago • 619k • 3

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated 18 days ago • 609k • 2

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated 14 days ago • 400k • 2

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • Updated 16 days ago • 856 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • Updated 15 days ago • 409 • 1

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • Updated 13 days ago • 287k • 2

MaziyarPanahi/ByteCraft-GGUF

Text Generation • Updated 10 days ago • 135 • 1

MaziyarPanahi/AURORAV0.3-4B-GGUF

Text Generation • Updated 7 days ago • 83 • 1

MaziyarPanahi/Malaysian-orpheus-3b-0.1-ft-GGUF

Text Generation • Updated 7 days ago • 116 • 1

Ayushnangia/bloom3B-2bit-gptq

Text Generation • Updated Aug 28, 2023 • 12

kaitchup/Llama-2-7b-gptq-2bit

Text Generation • Updated Sep 11, 2023 • 13 • 1

nesty/sg-bart-large-4096-gptq-2bit

Text2Text Generation • Updated Sep 21, 2023 • 6