tabbyAPI-ollama/endpoints
kingbri 2d89c96879 API: Re-add BOS token stripping in template render
Matching YALS, if the model has add_bos_token enabled, then remove
an extra BOS token at the start of the prompt. This usually happens
with misconfigured templates such as Llama 3.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-05-24 21:11:53 -04:00
..
core API: Add default for backend in model load request 2025-05-12 09:51:09 -04:00
Kobold Tree: Format 2025-05-17 00:46:40 -04:00
OAI API: Re-add BOS token stripping in template render 2025-05-24 21:11:53 -04:00
server.py Args: Expose api-servers to subcommands 2025-02-10 23:39:46 -05:00