TQ quant????
#1
by
phazei
- opened
First I've seen it, I tried googling it but could find zero info. Have any resource links?
These are experimental ternary quants.
https://github.com/ggml-org/llama.cpp/discussions/5063
https://github.com/ggml-org/llama.cpp/pull/8151
However upon testing them I noticed the output is broken. I don't know why.
So I recommend to stick with the IQ quants for this model, which are confirmed functional.