Fanboy again ; possible to do Qwen 3 16B-A3B ?
#8
by
DavidAU
- opened
Hey;
Was wondering if it is possible to "abliterate" / "Josiefied" this version:
https://huggingface.co/kalomaze/Qwen3-16B-A3B
I have downloaded/tested and Imatrixed - this version works great at 1/2 the size.
Kalomaze selected top 64 experts of 128 used , and made this version.
Thank you for all you do - your models are great.
I would like to see some benchmarks before using resources abliterating the 16B model.
Interesting model! I also think some benchmarks would be great, but after the OG models, why not :D