Bigger models of this?
Curious if you would be making a version of this using a bigger model? 32B, 70B, 100B?
Love the idea of this model, and it works rlly well, just think a bigger model could really do this type of system well. I did notice times where this model did not fully understand the context or words correctly in some messages, getting mad at a character even though the character agreed with them, etc...
I've noticed these context and wording issues too. This model has potential though. I think it need a V2 was made that fixes it up but it's creative and entertaining otherwise.
In case you haven't noticed, there's a 70B version now!
In case you haven't noticed, there's a 70B version now!
I tried it and... As much as I dislike Llama 3 70B... It's surprisingly good for normal back-and-forth roleplay, I've never had any coherence with 70B models until I tried this one. (104 messages in)
Using IQ4_XS
Thank you all!