Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,355

Full-text search

Active filters: 6-bit

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated 20 days ago • 621k • 3

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated 20 days ago • 611k • 2

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated 16 days ago • 402k • 2

mlx-community/c4ai-command-a-03-2025-6bit

Text Generation • Updated 14 days ago • 44 • 1

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • Updated 18 days ago • 890 • 1

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_6.0bpw_H8

Text Generation • Updated 18 days ago • 17 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • Updated 18 days ago • 409 • 1

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • Updated 15 days ago • 288k • 2

gghfez/Mistral-Small-3.1-24B-Instruct-2503-novision-exl2-6bpw

Updated 14 days ago • 59 • 1

MaziyarPanahi/ByteCraft-GGUF

Text Generation • Updated 13 days ago • 149 • 1

MaziyarPanahi/AURORAV0.3-4B-GGUF

Text Generation • Updated 9 days ago • 95 • 1

MaziyarPanahi/Malaysian-orpheus-3b-0.1-ft-GGUF

Text Generation • Updated 9 days ago • 131 • 1

ReadyArt/Forgotten-Transgression-24B-v4.1_EXL2_6.0bpw_H8

Updated 10 days ago • 22 • 2

FluffyKaeloky/Moist-Miqu-70B-v1-exl2-6.0bpw

Text Generation • Updated Jun 3, 2024 • 10 • 1

MikeRoz/sophosympatheia_Nova-Tempus-70B-v0.2-6.0bpw-h6-exl2

Text Generation • Updated Feb 3 • 11 • 1

ReadyArt/Forgotten-Safeword-22B_EXL2_6bpw_H8

Updated Feb 15 • 17 • 1

ReadyArt/Forgotten-Safeword-v1.1-22B_EXL2_6bpw_H8

Updated Feb 18 • 9 • 1

ReadyArt/Forgotten-Safeword-24B-V1.2-6.0bpw-h8-exl2

Updated Feb 20 • 9 • 1

ReadyArt/Forgotten-Abomination-24B_EXL2_6bpw_H8

Updated Feb 21 • 10 • 1

mlx-community/Forgotten-Abomination-24B-v1.2-6bit

Updated Feb 22 • 8 • 2

ReadyArt/Forgotten-Safeword-24B-V2.2_EXL2_6bpw_H8

Updated Feb 25 • 27 • 2

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 7 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • Updated Jan 26, 2024 • 787 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 147 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 710 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30, 2024 • 825 • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 74 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • Updated Jan 26, 2024 • 486 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 83 • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 57 • 2