Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

13,501

Full-text search

Active filters: imatrix

mradermacher/MN-Hekate-Ekklesia-12B-i1-GGUF

Updated 6 days ago • 585 • 2

ArtusDev/ToastyPigeon_Gemma-3-Starshine-12B-GGUF

Text Generation • Updated 4 days ago • 184 • 2

mradermacher/Community_Request-04.20-12B-i1-GGUF

Updated 5 days ago • 615 • 2

Mungert/Qwen2.5-VL-32B-Instruct-GGUF

Image-Text-to-Text • Updated 3 days ago • 787 • 2

bartowski/Tarek07_Legion-V2.1-LLaMa-70B-GGUF

Text Generation • Updated 4 days ago • 377 • 2

mradermacher/Irix-12B-Model_Stock-i1-GGUF

Updated 4 days ago • 152 • 2

tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E160-IQ1_S

Updated 2 days ago • 24 • 2

mradermacher/GenericRPV2-7B-i1-GGUF

Updated 1 day ago • 52 • 2

mradermacher/Midnight-Miqu-103B-v1.0-i1-GGUF

Updated May 10, 2024 • 238 • 4

Lewdiculous/Datura_7B-GGUF-Imatrix

Updated Mar 8, 2024 • 53 • 6

mradermacher/Midnight-Rose-70B-v2.0.3-i1-GGUF

Updated May 10, 2024 • 142 • 1

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 645 • 13

webbigdata/C3TR-Adapter_gguf

Translation • Updated Aug 14, 2024 • 383 • 24

dranger003/c4ai-command-r-plus-iMat.GGUF

Text Generation • Updated May 6, 2024 • 2.56k • 140

backyardai/WizardLM-2-8x22B-GGUF

Updated May 22, 2024 • 725 • 1

qwp4w3hyb/Not-WizardLM-2-8x22B-iMat-GGUF

Updated Apr 21, 2024 • 211 • 3

mradermacher/Llama-3-8B-Ultra-Instruct-i1-GGUF

Updated Dec 16, 2024 • 500 • 2

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Jun 30, 2024 • 3.31k • 49

bartowski/Llama-3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 2, 2024 • 1.51k • 42

mradermacher/Llama-3-Soliloquy-8B-v2-i1-GGUF

Updated Feb 21 • 660 • 5

bartowski/35b-beta-long-GGUF

Text Generation • Updated May 6, 2024 • 1.49k • 28

mmnga/Fugaku-LLM-13B-instruct-gguf

Updated May 12, 2024 • 3.81k • 5

backyardai/Midnight-Rose-70B-v2.0.3-GGUF

Updated May 22, 2024 • 2.1k • 5

mmnga/japanese-stablelm-2-instruct-1_6b-gguf

Updated May 11, 2024 • 2.27k • 3

Lewdiculous/llama-3-cat-8b-instruct-v1-GGUF-IQ-Imatrix

Updated May 13, 2024 • 812 • 18

mradermacher/UnFimbulvetr-20B-V2-i1-GGUF

Updated 27 days ago • 625 • 4

bartowski/llama-3-70B-Instruct-abliterated-GGUF

Text Generation • Updated May 16, 2024 • 637 • 6

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 601 • 94

bartowski/aya-23-35B-GGUF

Text Generation • Updated May 23, 2024 • 2.28k • 27

knifeayumu/LLM_Collection

Updated Feb 28 • 9.03k • 10