Q4_K_S give 2 sentences then repeats itself over and over forever
#1
by
phazei
- opened
Are there some special settings I'm supposed to use? This seems to be broken. It just repeats itself after a couple lines almost all the time.
Will take a look
Tested with LMStudio 0.3.13 and Llama3 preset
It works fine for me.
Make sure you're using stopwords param and format your prompts correctly.
Stopwords? I'm using 0.3.15. Proper GLM support just dropped, but the issue persists.
Here's a screenshot with all my settings: