How to use the instruct version of this model
Hi,
how do I get the best results using the instruct versions? Do I have to follow the same template format than the standard Llama3 model?
Also should I write my prompts in german or in english?
Hello Stefan,
The template is the same as the standard llama3. Write the prompts in German. This is a German-focused model.
Hope this helps.
dont work well!
jinja template from llama3
...
{%- set loop_messages = messages %}
{%- for message in loop_messages %}
{%- set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}
{{- content }}
{%- endfor %}
{%- if add_generation_prompt %}
{{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
{%- endif %}
....
with 8 snippets a 1024 chracters
model dont answer
i test 100 models with same setup!