A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Thien Tran
gaunernst
AI & ML interests
None yet
Recent Activity
new activity
17 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Broken results with vLLM
new activity
22 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Cannot find the config file for awq
new activity
22 days ago
gaunernst/gemma-3-27b-it-int4-awq:Model running badly on vLLM
Organizations
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 25 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 960 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.54k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.18k • 10
A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 25 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 960 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.54k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.18k • 10
models
55
gaunernst/vit_base_patch16_1024_128.audiomae_as2m
0.1B
•
Updated
•
60
•
1
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text
•
6B
•
Updated
•
2.18k
•
10
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text
•
6B
•
Updated
•
1.61k
•
9
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text
•
3B
•
Updated
•
1.24k
•
1
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text
•
2B
•
Updated
•
2.32k
•
2
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation
•
0.4B
•
Updated
•
189
gaunernst/DeepSeek-V2-Lite-Chat-FP8
16B
•
Updated
•
852
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text
•
3B
•
Updated
•
1.54k
•
6
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text
•
2B
•
Updated
•
960
•
1
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
0.4B
•
Updated
•
25
datasets
11
gaunernst/ms1mv3-recordio
Updated
•
22
•
1
gaunernst/flux-dev-portrait
Viewer
•
Updated
•
2k
•
126
•
1
gaunernst/pexels-portrait
Viewer
•
Updated
•
9.85k
•
16
•
1
gaunernst/ffhq-1024-wds
Viewer
•
Updated
•
70.3k
•
105
gaunernst/face-recognition-eval
Updated
•
3
gaunernst/voxceleb2-dev-wds
Viewer
•
Updated
•
1.09M
•
36
gaunernst/glint360k-wds-gz
Viewer
•
Updated
•
17.1M
•
220
•
3
gaunernst/webface4m-wds-gz
Viewer
•
Updated
•
4.24M
•
217
•
3
gaunernst/ms1mv3-wds-gz
Viewer
•
Updated
•
5.18M
•
75
•
2
gaunernst/tokenized-datasets
Updated
•
7