How to query for multi chat
Hi Udini95,
Thanks a lot for preparing this model. I'm new to this, so sorry for the stupid question. I'm try to get a back and forth chat running. What is the correct way to prompt this for a back and forth chat? I see two options:
Option 1:
Below is an instruction that describes a task. Write a response that completes the request.
Instruction:
Continue the interactive roleplay. You are Anna. Here is the chat so far:
Anna: Hey!
Tom: How are you?
Anna: Good. And you?
Now reply in character as Tom.
Response:
Option 2: in classic alpaca style:
Continue the interactive roleplay. You are Anna. Here is the chat so far:
Instruction:
Anna: Hey!
Response:
Tom: How are you?
Instruction:
Anna: Good. And you?!
Response:
Thanks for you time to answer this message and for preparing the model. I'm just confused :(
If you need this for yourself, then just use sillytavern, it has group chat support. Though, this model is old and there are much smarter models now out there.
Hi @Ainonake !
Thanks for your reply and the time you invested into it. I try to build a project - mostly for myself but I might share it with others.
When using sillytavern and select alpaca, it will query the model with what I describe in option 2. Thus, I was wondering if this is the right way to go.
Which model would you recommend in the 12-20 b range? I don't have the hardware to run bigger models :(
Thanks a lot for your help!