Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Carbon Emissions

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

287

Full-text search

Active filters: ggml

afrideva/Qwen2-0.5B-GGUF

Text Generation • Updated Jun 6, 2024 • 82 • 1

afrideva/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 37 • 1

afrideva/Qwen2-1.5B-GGUF

Text Generation • Updated Jun 6, 2024 • 105

afrideva/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 57 • 2

afrideva/dolphin-2.9.3-qwen2-0.5b-GGUF

Text Generation • Updated Jun 17, 2024 • 35 • 1

ruslanmv/instructLab-granite-7b-lab-text-to-sql

Updated Jul 19, 2024 • 14

ruslanmv/instructLab-granite-7b-lab-text-to-sql-4bits

Updated Jul 19, 2024 • 4

leafspark/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 25, 2024 • 56 • 22

leafspark/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 24, 2024 • 4

leafspark/L3.1-70B-Celeste-v0.1-GGUF

Text Generation • Updated Aug 8, 2024 • 3 • 1

hassu619/Llama-2-7b-chat-finetune_UNI-GGML

Question Answering • Updated Aug 20, 2024 • 1

leafspark/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated Sep 10, 2024 • 408 • 27

jhofseth/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated Sep 13, 2024 • 39 • 2

royshilkrot/whisper-medium-korean-ggml

Automatic Speech Recognition • Updated Oct 30, 2024 • 1

AcerTest359/ggml_clip-vit-base-patch32

Updated Jan 10 • 101

yqnis/llama3-8b-quaero-gguf

Updated Apr 10 • 23

yqnis/mistral-7b-quaero-gguf

Updated Apr 11 • 3