I notice need Qwen2, but for SillyTavern, what I need to use?
#2
by
RGTails
- opened
All is in title.
Run this model with koboldcpp/ollama/lmstudio/text generation webui and connect to it from sillytavern.
I recommend Mistral thinker more though.
Run this model with koboldcpp/ollama/lmstudio/text generation webui and connect to it from sillytavern.
I recommend Mistral thinker more though.
Did you have link for Mistral thinker template?
Because I have only this concerning Mistral and nothing work correctly.
Mistral tekken v7.
Add
"<think>
" to prefill
Uh hf was displaying it incorrectly.
<think> should be there