DavidAU
/

Reka-Flash-3-21B-Reasoning-Uncensored-MAX-NEO-Imatrix-GGUF

Hey! What's the instruct template for this model please, it's impossible to find... for me it runs absolutely terrible, talks for the user, stutters in its text, merging up words on its first response... hope a correct instruct can fix it. Thanks!

DavidAU

Owner 2 days ago

This model works with the Jijna template (embedded in the GGUFs).
In Lmstudio this will load automatically, as it also should in using Llama-Server.exe (Llamacpp Guthub).
You may be able to use Llama 3 instruct as a fall back.

In SillyTavern - use "text completion" - this should then use the Jinja Template.

To construct a template manually:
Contact the org model maker and open a ticket in the "community tab":
https://huggingface.co/RekaAI/reka-flash-3

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment