GGUF
#1
by
amogusgaysex
- opened
Please any gguf version ? I tried doing it myself but i keep getting broken replies
amogusgaysex
changed discussion status to
closed
Try this:- QuantFactory/Meditron3-Gemma2-2B-GGUF
Still very broken for some reason
Tested q8 and q6 in llama.cpp and pocketpal (android), same schizo results every time
amogusgaysex
changed discussion status to
open