Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,990

Full-text search

Active filters: 2-bit

kaitchup/Phi-4-mini-instruct-AutoRoundGPTQ-2bit

Text Generation • Updated Feb 28 • 45

MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.03-GGUF

Text Generation • Updated Feb 28 • 14

MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.03-GGUF

Text Generation • Updated Feb 28 • 64

MaziyarPanahi/cursa-o1-7b-v1.1-GGUF

Text Generation • Updated Feb 28 • 20

MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.02-GGUF

Text Generation • Updated Feb 28 • 11

MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.02-GGUF

Text Generation • Updated Feb 28 • 24

MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.01-GGUF

Text Generation • Updated Feb 28 • 24

MaziyarPanahi/Vikhr-YandexGPT-5-Lite-8B-it-GGUF

Text Generation • Updated Feb 28 • 52

MaziyarPanahi/Clarus-7B-v0.3-GGUF

Text Generation • Updated Feb 28 • 10

mku64/SmolLM2-360M-Instruct-Q2-mlx

Text Generation • Updated Feb 28 • 20

MaziyarPanahi/Llama_3.1_8b_Hermedive_R1_V1.01-GGUF

Text Generation • Updated Mar 1 • 93

MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.01-GGUF

Text Generation • Updated Mar 1 • 13

MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.01-GGUF

Text Generation • Updated Mar 1 • 61

MaziyarPanahi/Llama_3.1_8b_Medusa_v1.01-GGUF

Text Generation • Updated Mar 1 • 81

MaziyarPanahi/Llama_3.1_8b_Dolermed_V1.01-GGUF

Text Generation • Updated Mar 1 • 120

MaziyarPanahi/Llama_3.1_8b_Hermedive_V1.01-GGUF

Text Generation • Updated Mar 1 • 172

MaziyarPanahi/Llama_3.1_8b_Smarteaz_V1.01-GGUF

Text Generation • Updated Mar 1 • 113

MaziyarPanahi/Fireball-R1.1-Llama-3.1-8B-GGUF

Text Generation • Updated Mar 1 • 111

MaziyarPanahi/Latxa-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Mar 1 • 49

MaziyarPanahi/Lacerta-Opus-14B-Elite8-GGUF

Text Generation • Updated Mar 1 • 114

MaziyarPanahi/fan-o1-7b-GGUF

Text Generation • Updated Mar 1 • 100

MaziyarPanahi/Llama_3.1_8b_Hermedive_R1_V1.03-GGUF

Text Generation • Updated Mar 1 • 106

MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.03-GGUF

Text Generation • Updated Mar 1 • 106

Koutouzov1973/ministral_8b_generex_environnement_quantized_4b_2bit

Updated about 1 month ago • 11

alexgusevski/Phi-4-mini-instruct-Q2-mlx

Text Generation • Updated about 1 month ago • 30

Dessicated/Hermes-3-Llama-3.1-405B-Uncensored-Q2-mlx

Updated 30 days ago

KYUNGYONG/DeepSeek-llama3.3-Bllossom-70B-Q2-mlx

Text Generation • Updated 30 days ago • 60

MaziyarPanahi/granite-3.2-8b-instruct-abliterated-GGUF

Text Generation • Updated 29 days ago • 349

MaziyarPanahi/BeyondRP-8B-GGUF

Text Generation • Updated 29 days ago • 370

MaziyarPanahi/granite-3.2-2b-instruct-abliterated-GGUF

Text Generation • Updated 29 days ago • 404