Inference Providers
Active filters: cuda
Text Generation
• 8B • Updated • 105k
• 669
prism-ml/Bonsai-1.7B-gguf
Text Generation
• 2B • Updated • 22.5k
• 65
Text Generation
• 4B • Updated • 15k
• 40
atomicmilkshake/llama-cpp-turboquant-binaries
ValiantLabs/gemma-4-E2B-it-ShiningValiant3
Image-Text-to-Text
• 5B • Updated • 36
• 3
ValiantLabs/gemma-4-E4B-it-ShiningValiant3
Image-Text-to-Text
• 8B • Updated • 28
• 4
ValiantLabs/gpt-oss-20b-ShiningValiant3
Text Generation
• 21B • Updated • 17
• 19
dougeeai/llama-cpp-python-wheels
Multilingual-Multimodal-NLP/IndustrialCoder
Text Generation
• 32B • Updated • 1.2k
• 58
pranay5255/flash-attn-v2-ampere
ussoewwin/Flash-Attention-2_for_Windows
Text Generation
• Updated • 10
• 23
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
• Updated • 10
marcorez8/llama-cpp-python-windows-blackwell-cuda
ValiantLabs/Qwen3-8B-ShiningValiant3
Text Generation
• 8B • Updated • 14
• 3
mradermacher/Qwen3-8B-ShiningValiant3-GGUF
8B • Updated • 1.51k
• 2
mradermacher/Qwen3-8B-ShiningValiant3-i1-GGUF
8B • Updated • 2.41k
• 2
ValiantLabs/Qwen3-1.7B-ShiningValiant3
Text Generation
• 2B • Updated • 28
• 5
mradermacher/Qwen3-1.7B-ShiningValiant3-GGUF
2B • Updated • 196
mradermacher/Qwen3-1.7B-ShiningValiant3-i1-GGUF
2B • Updated • 425
ValiantLabs/Qwen3-4B-ShiningValiant3
Text Generation
• 4B • Updated • 34
• 7
sequelbox/Qwen3-8B-PlumEsper
Text Generation
• 8B • Updated • 3
sequelbox/Qwen3-4B-PlumEsper
Text Generation
• 4B • Updated • 3
mradermacher/Qwen3-Shining-Lucy-CODER-3.5B-Brainstorm20x-e32-GGUF
3B • Updated • 198
• 2
mradermacher/Qwen3-Shining-Lucy-CODER-2.4B-mix2-GGUF
2B • Updated • 155
mradermacher/Qwen3-Shining-Lucy-CODER-2.4B-GGUF
2B • Updated • 131
mradermacher/Qwen3-Shining-Lucy-CODER-2.4B-mix2-i1-GGUF
2B • Updated • 128
• 1
mradermacher/Qwen3-Shining-Lucy-CODER-2.4B-i1-GGUF
2B • Updated • 597
mradermacher/Qwen3-Shining-Lucy-CODER-3.5B-Brainstorm20x-e32-i1-GGUF
3B • Updated • 523
• 1