Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,723

Full-text search

Active filters: quantized

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18 • 1.41M • 8

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated 2 days ago • 29.6k • 5

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17 • 1.37k • 4

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.75M • 8

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 52.9k • 124

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.8M • 62

afrideva/malaysian-tinyllama-1.1b-16k-instructions-GGUF

Text Generation • Updated Nov 12, 2023 • 65 • 1

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 121 • 2

afrideva/zephyr-smol_llama-100m-sft-full-GGUF

Text Generation • Updated Nov 28, 2023 • 1.43k • 2

afrideva/malaysian-mistral-1.1B-4096-GGUF

Text Generation • Updated Nov 29, 2023 • 129 • 1

afrideva/tiny-llama-1.1b-chat-medical-GGUF

Text Generation • Updated Dec 1, 2023 • 198 • 4

MaziyarPanahi/MetaMath-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 146 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 5.75k • 49

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30 • 23

qualcomm/Baichuan-7B

Text Generation • Updated Oct 10 • 7

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 5 days ago • 23

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 4 days ago • 143k • 91

Lewdiculous/opus-v1.2-7b-GGUF-IQ-Imatrix

Text Generation • Updated Mar 2 • 257 • 6

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2 • 1.69k • 13

Lewdiculous/Layris_9B-GGUF-IQ-Imatrix

Text Generation • Updated May 4 • 409 • 16

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 567 • 24

Lewdiculous/Eris_PrimeV3-Vision-7B-GGUF-IQ-Imatrix

Updated Mar 21 • 770 • 13

Lewdiculous/Eris_PrimeV3.05-Vision-7B-GGUF-IQ-Imatrix

Updated Mar 23 • 439 • 5

Lewdiculous/RP_Vision_7B-GGUF-IQ-Imatrix

Updated Mar 23 • 458 • 5

ilsp/Meltemi-7B-Instruct-v1-GGUF

Updated Apr 18 • 28 • 14

Lewdiculous/KukulStanta-7B-GGUF-IQ-Imatrix

Updated Apr 7 • 208 • 9

Lewdiculous/Aura_7B-GGUF-IQ-Imatrix

Updated Apr 15 • 91 • 5

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4 • 1.48k • 45

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 1.75M • 74

Lewdiculous/Aura_v2_7B-GGUF-IQ-Imatrix

Updated Apr 16 • 182 • 11