W4A16 quants made with llmcompressor
Ben Shankles PRO
warshanks
AI & ML interests
MLX, AWQ, GPTQ
Recent Activity
liked
a model
about 7 hours ago
SaisExperiments/Voxtral-3B-But-4B-Text-Only
updated
a model
about 8 hours ago
warshanks/Voxtral-Mini-3B-2507-FP8
published
a model
about 8 hours ago
warshanks/Voxtral-Mini-3B-2507-FP8
Organizations
MedGemma MLX conversions I've done
-
mlx-community/medgemma-4b-it-4bit
Image-Text-to-Text • 0.9B • Updated • 192 • 2 -
mlx-community/medgemma-4b-it-6bit
Image-Text-to-Text • 1B • Updated • 70 • 1 -
mlx-community/medgemma-4b-it-8bit
Image-Text-to-Text • 1B • Updated • 80 • 1 -
mlx-community/medgemma-4b-it-bf16
Image-Text-to-Text • 5B • Updated • 1.09k • 1
W4A16 quants made with llmcompressor
MedGemma MLX conversions I've done
-
mlx-community/medgemma-4b-it-4bit
Image-Text-to-Text • 0.9B • Updated • 192 • 2 -
mlx-community/medgemma-4b-it-6bit
Image-Text-to-Text • 1B • Updated • 70 • 1 -
mlx-community/medgemma-4b-it-8bit
Image-Text-to-Text • 1B • Updated • 80 • 1 -
mlx-community/medgemma-4b-it-bf16
Image-Text-to-Text • 5B • Updated • 1.09k • 1
spaces
7
pinned
Running
on
Zero
1
MedGemma 27B IT
🩻
Chat with MedGemma 27B, a medical variant of Gemma 3
pinned
Running
on
Zero
19
MedGemma 4B IT
🩻
Chat with MedGemma 4B, a medical variant of Gemma 3
pinned
Running
on
Zero
8
Lingshu 7B
🩻
Chat with Lingshu 7B, a multimodal medical model
pinned
Running
on
Zero
3
Lingshu 32B
🩻
Chat with Lingshu 32B, a multimodal medical model
Running
on
Zero
FLUX.1 [dev]
🖥
Generate images from text prompts
Sleeping
Seinfeld
☕
Chat with Seinfeld powered by Gemini
models
7
warshanks/Voxtral-Mini-3B-2507-FP8
Audio-Text-to-Text
•
Updated
warshanks/Jan-nano-128k-AWQ
Text Generation
•
1B
•
Updated
•
16
warshanks/Jan-nano-AWQ
Text Generation
•
1B
•
Updated
•
8
•
1
warshanks/Qwen3-4B-abliterated-AWQ
Text Generation
•
1B
•
Updated
•
24
warshanks/Ministral-8B-Instruct-2410-AWQ
2B
•
Updated
•
22
warshanks/Josiefied-Qwen3-4B-abliterated-v2-AWQ
Text Generation
•
1B
•
Updated
•
34
warshanks/gpt2-xl-bf16
2B
•
Updated
•
139
datasets
0
None public yet