Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,528

Full-text search

Active filters: llama-cpp

jinao/secgpt-Q4_K_M-GGUF

Text Generation • Updated Aug 28, 2024 • 52 • 4

redhat6/Phi-3.5-mini-instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 3, 2024 • 48 • 2

Triangle104/Meta-Llama-3.1-8B-Instruct-abliterated-Q5_K_M-GGUF

Updated Nov 25, 2024 • 38 • 1

stephenlzc/Llama-3-8B-Lexi-Uncensored-Q2_K-GGUF

Updated Sep 19, 2024 • 16 • 1

Triangle104/Qwen2.5-Coder-7B-Q5_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 35 • 1

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 75 • 4

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 25.3k • 15

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 58.4k • 30

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 24.5k • 47

mylesgoose/Llama-3.2-3B-instruct-abliterated-Q8_0-GGUF

Updated Sep 27, 2024 • 33 • 4

Gaspardno/flan-t5-small-Q4_K_M-GGUF

Text2Text Generation • Updated Oct 16, 2024 • 18 • 1

lagoon999/Chuxin-Embedding-Q8_0-GGUF

Updated Oct 30, 2024 • 18 • 2

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated Nov 5, 2024 • 1.02k • 41

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Updated Oct 31, 2024 • 2.78k • 27

sheldonrobinson/all-MiniLM-L12-v2-Q4_K_M-GGUF

Sentence Similarity • Updated Nov 4, 2024 • 21 • 1

sheldonrobinson/gemma-7b-aps-it-Q8_0-GGUF

Text Generation • Updated Nov 4, 2024 • 30 • 1

sheldonrobinson/gemma-7b-aps-it-Q4_K_M-GGUF

Text Generation • Updated Nov 4, 2024 • 17 • 1

thanhtan2136/GemSUra-7B-Q4_K_M-GGUF

Updated Nov 14, 2024 • 5 • 1

win10/miscii-14b-1028-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 6 • 2

smcleod/mxbai-embed-large-v1-Q8_0-GGUF

Feature Extraction • Updated Nov 19, 2024 • 4 • 1

yemiao2745/Qwen2.5-14B-Instruct-Uncensored-Q4_K_M-GGUF

Updated Nov 23, 2024 • 69 • 3

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • Updated Nov 26, 2024 • 2.21k • 5

Fishkaras/embedic-large-Q8_0-GGUF

Sentence Similarity • Updated Nov 27, 2024 • 14 • 1

puettmann/LlaMaestra-3.2-1B-Translation-Q8_0-GGUF

Translation • Updated Dec 8, 2024 • 12 • 1

t-tech/T-pro-it-1.0-Q4_K_M-GGUF

Updated Dec 17, 2024 • 224 • 6

t-tech/T-pro-it-1.0-Q5_K_M-GGUF

Updated Dec 17, 2024 • 39 • 3

t-tech/T-pro-it-1.0-Q6_K-GGUF

Updated Dec 17, 2024 • 35 • 1

t-tech/T-pro-it-1.0-Q8_0-GGUF

Updated Dec 17, 2024 • 153 • 8

t-tech/T-lite-it-1.0-Q8_0-GGUF

Updated Dec 17, 2024 • 334 • 17

redhat6/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated Dec 23, 2024 • 4 • 1