Awesome finetune
I wasnt this giddy since Stheno 3.2
Well done and thanks <3
i have to agree! best local model i have ever tried in many respects. no repetitions whatsoever, handles complex instructions very well. long context recall is great.
hi. is anyone have a script to convert the model to AWQ
i have to agree! best local model i have ever tried in many respects. no repetitions whatsoever, handles complex instructions very well. long context recall is great.
Willing to share your sampling settings?
i have to agree! best local model i have ever tried in many respects. no repetitions whatsoever, handles complex instructions very well. long context recall is great.
Willing to share your sampling settings?
No repetition penalty, i liked 0.8-1.0 temperature the most, top k/p i didn't really adjust as it worked out of the box.