Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,416

Full-text search

Active filters: imatrix

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 567 • 24

qwp4w3hyb/Not-WizardLM-2-8x22B-iMat-GGUF

Updated Apr 21 • 426 • 2

Lewdiculous/Chaos_RP_l3_8B-GGUF-IQ-Imatrix

Updated May 4 • 345 • 19

Lewdiculous/SOVL_Llama3_8B-GGUF-IQ-Imatrix

Updated May 4 • 772 • 28

bartowski/Einstein-v6.1-Llama3-8B-GGUF

Text Generation • Updated May 2 • 369 • 7

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10 • 2.65k • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19 • 67 • 6

bartowski/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • Updated May 4 • 404 • 30

bartowski/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated May 4 • 236 • 2

mradermacher/Palmyra-Med-70B-i1-GGUF

Updated Sep 20 • 350 • 1

Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix

Updated May 12 • 7.98k • 62

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7 • 657 • 8

lmstudio-community/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • Updated May 9 • 423 • 47

Lewdiculous/Orthocopter_8B-GGUF-Imatrix

Updated May 10 • 133 • 13

backyardai/Midnight-Rose-70B-v2.0.3-GGUF

Updated May 22 • 1.54k • 1

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22 • 1.75k • 6

bartowski/Nxcode-CQ-7B-orpo-GGUF

Text Generation • Updated May 11 • 538 • 6

bartowski/bagel-8b-v1.0-GGUF

Text Generation • Updated May 11 • 1.52k • 2

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12 • 1.93k • 20

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13 • 306 • 9

lmstudio-community/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated May 13 • 416 • 10

Lewdiculous/llama-3-cat-8b-instruct-v1-GGUF-IQ-Imatrix

Updated May 13 • 135 • 17

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15 • 209 • 2

bartowski/Hermes-2-Theta-Llama-3-8B-GGUF

Text Generation • Updated May 18 • 1.22k • 14

leafspark/DeepSeek-V2-Chat-GGUF

Text Generation • Updated Jun 16 • 574 • 24

bartowski/granite-20b-code-instruct-GGUF

Text Generation • Updated Sep 1 • 2.74k • 7

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • Updated Aug 13 • 43.2k • 55

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.33k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 3.07k • 42

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 1.87k • 6