tabbyAPI-ollama/templates/chatml.jinja
kingbri 271f5ba7a4 Templates: Modify alpaca and chatml
Add the stop_strings metadata parameter.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-03-27 22:28:41 -04:00

6 lines
405 B
Django/Jinja

{# Metadata #}
{% set stop_strings = ["<|im_start|>", "<|im_end|>"] %}
{# Template #}
{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content']}}{% if (loop.last and add_generation_prompt) or not loop.last %}{{ '<|im_end|>' + '\n'}}{% endif %}{% endfor %}
{% if add_generation_prompt and messages[-1]['role'] != 'assistant' %}{{ '<|im_start|>assistant\n' }}{% endif %}