tabbyAPI-ollama/endpoints/OAI/utils
kingbri 2913ce29fc API: Add timings to usage stats
It's useful for the client to know what the T/s and total time for
generation are per-request.

Works with both completions and chat completions.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-06-17 22:54:51 -04:00
..
chat_completion.py API: Add timings to usage stats 2025-06-17 22:54:51 -04:00
completion.py API: Add timings to usage stats 2025-06-17 22:54:51 -04:00
embeddings.py API: Format and fix message naming 2025-04-28 22:36:30 -04:00
tools.py Support more common tool variables in templates (tools, message.tool_calls) (#308) 2025-03-23 13:23:00 -04:00