Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,350

Full-text search

Active filters: 6-bit

ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_6.0bpw_H8

Text Generation • Updated 3 days ago • 2

ReadyArt/Anathema-V2-LLaMA-70B_EXL2_6.0bpw_H8

Text Generation • Updated 3 days ago • 3

ReadyArt/Forgotten-Safeword-36B-v4.1_EXL2_6.0bpw_H8

Updated 3 days ago • 6

ReadyArt/Forgotten-Safeword-70B-v5.0_EXL2_6.0bpw_H8

Text Generation • Updated about 9 hours ago • 6

Mawdistical/Feline-Clairvoyance-72B_EXL2_6.0bpw_H8

Updated 1 day ago • 4

huggingtoots/Wayfarer_Eris_Noctis-12B-mlx-6Bit

Text Generation • Updated 1 day ago • 3

ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_6.0bpw_H8

Text Generation • Updated about 16 hours ago

Mawdistical/Wanton-Wolf-70B_EXL2_6.0bpw_H8

Updated about 15 hours ago

litmudoc/Qwen2.5-14B-1M-YOYO-V5-MLX-Q6

Text Generation • Updated about 9 hours ago

dong-99/DeepSeek-V2.5-1210-mlx-6Bit

Text Generation • Updated about 6 hours ago