Keeps repeating itself.
Q4K_M. Simple role-play. LM Studio. RTX3090.
Every 4th line or so is basically a repeat of what it said in the previous response.
I thought at first it was because the context too long, when asking it to proof read a novel. But even a simple role-play, less than 10% of context used, with context set at 32K, it's repeating itself again.
When it works it's great, but at the same time it's totally trash and useless. Someone said there are known issues with the 3090? I have no idea how that would work? They also said there's an update, but from the looks of this it's not updated?
Hi @rdtfddgrffdgfdghfghdfujgdhgsf ,
Even when only a small portion of the context window is used, this repetition issue still shows up and it’s not just limited to the RTX 3090. With different hardware setups have reported similar problems.
Could you please try to tweak the Sampling Settings:
- Higher temperature values help make the responses less predictable and reduce repetition.
- Adding a penalty (like 1.1) discourages the model from saying the same thing over and over.
- Adjusting Top-k / Top-p can also help bring in more variety and control the randomness in the output.
Finally, make sure running the latest version of LM Studio because new releases can solve this type of issues. For more information, could you please refer to this reference.
Thank you.