-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
MaziyarPanahi/VibeThinker-1.5B-GGUF
Text Generation
•
2B
•
Updated
•
16.9k
•
35
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
92.6k
•
19
MaziyarPanahi/MN-Violet-Lotus-12B-GGUF
Text Generation
•
12B
•
Updated
•
378
•
1
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
•
12B
•
Updated
•
167k
•
12
lmstudio-community/Devstral-Small-2505-MLX-6bit
Text Generation
•
5B
•
Updated
•
217
•
7
ArtusDev/PocketDoc_Dans-PersonalityEngine-V1.3.0-24b_EXL2_6.0bpw_H6
Text Generation
•
Updated
•
9
•
1
mlx-community/Kimi-Dev-72B-6bit
Text Generation
•
73B
•
Updated
•
54
•
1
mlx-community/GLM-4.5-Air-6bit
Text Generation
•
107B
•
Updated
•
76
•
3
mlx-community/Kimi-VL-A3B-Thinking-2506-6bit
Image-Text-to-Text
•
Updated
•
85
•
2
mlx-community/Qwen3-Next-80B-A3B-Instruct-6bit
Text Generation
•
80B
•
Updated
•
151
•
3
mlx-community/Qwen3-Next-80B-A3B-Thinking-6bit
Text Generation
•
80B
•
Updated
•
75
•
1
sjgdr/Llama3-Med42-70B-mlx-6Bit
Text Generation
•
71B
•
Updated
•
48
•
1
mlx-community/DeepSeek-OCR-6bit
Image-Text-to-Text
•
1.0B
•
Updated
•
787
•
1
mlx-community/Kimi-Linear-48B-A3B-Instruct-6bit
Text Generation
•
49B
•
Updated
•
1.03k
•
3
zerofata/MS3.2-PaintedFantasy-v3-24B-exl3-6bpw
Text Generation
•
9B
•
Updated
•
47
•
1
MaziyarPanahi/Qwen3-4B-Thinking-2507-GGUF
Text Generation
•
4B
•
Updated
•
12k
•
1
garrison/GLM-4.5-Air-Derestricted-mlx-6Bit
Text Generation
•
107B
•
Updated
•
115
•
1
DeathGodlike/ThetaBlackGorgon-8B_EXL3
Text Generation
•
Updated
•
3
•
1
MaziyarPanahi/NVIDIA-Nemotron-Nano-9B-v2-GGUF
Text Generation
•
9B
•
Updated
•
69
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
6
•
1
MaziyarPanahi/phi-2-GGUF
Text Generation
•
3B
•
Updated
•
276
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
117
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
157
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
221
•
5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
•
7B
•
Updated
•
128
•
3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
135
•
2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
200
•
2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
140
•
2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
126
•
1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
170
•
1