Gemma 3 27B Abliterated Q4KM and Q3KM on ollama?
#1
by
StatusQuo209
- opened
Would you be able to upload Q3KM and Q4KM versions to the Ollama site? If you only get time for one, the Q3KM version would be ideal. So far the lowest quant you have is Q8 and that doesn't fit on a 3090.
I appreciate your work. Thank you.
Nevermind. Just saw your post on model card that Q4KM doesn't work.