Extremely Underrated
There are exl3 quants currently available https://huggingface.co/DeathGodlike/Rei-24B-KTO_EXL3 and I suggest people to test it out.
Severely underrated, passes my homebrewed logic tests consistently, and the outputs are varied and make each generation interesting.
Currently my go-to model for RP, and I have tested many. Better logic capabilities (and more verbose, but conciseness is a subjective preference) than the new Austral 32B GLM4 Winton (tested q6), better output and logic than Archaeo 32B (q6) and latest (<70B) ReadyArt models. Highly recommended. Can fit exl3 8bpw with a 89600 context within a dual 24G GPU setup (and much more in lower quants, which can fit inside a single GPU comfortably).
Seems to be compatible with Alpaca formatting as well, and it gets rid of some formatting issues with Mistral V7 Tekken while using impersonate in ST.
Glad you liked it! =)