Text Generation
Transformers
GGUF
English
TensorBlock
GGUF
conversational

Activation of "thinking" block method.

#1
by DavidAU - opened

I found that using "chatml" template (manually selected) and this system prompt:

You are an AI focused on providing systematic, well-reasoned responses. Response Structure: - Format: {reasoning}{answer} - Process: Think first, then answer.

Activates the thinking "block" and output generation.

However, I see at the source repo the "tokenizer... json" was updated 4 days ago, so this might fix the issue with the "jinja template" / "block" reasoning activation.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment