repetition
Did anyone notice bad repetition when roleplaying ? Phrases are repeated over multiple messages, I've tried many sampler settings including the recommended ones with presence penalty. I've also heard of many other people having this issue so it seems like a model problem.
Yes, the problem is too severe to proceed in vllm . I'll temporarily switch back to QwQ32B until a fix is available
Repetion always happen when I use the model on long contexts with YaRN enabled. Did you also use YaRN?
Unusably repetitive at just 8k context, no matter what settings are used. Refuses to drive the story, just repeats the same descriptions/dialogue with a few subtle changes. Repeats the same words & phrases from one story in another, despite different setting & scenario. Also forgets details immediately, when not close to max context length. A character is drinking a silver liquid out of a tumbler. Then the liquid is amber. Then they're drinking out of a wineglass. An object that was placed in a desk falls out of a character's pocket, etc.