tabbyAPI-ollama/endpoints/core
kingbri bd9e78e19e API: Add inline exception for dummy models
If an API key sends a dummy model, it shouldn't error as the server
is catering to clients that expect specific OAI model names. This
is a problem with inline model loading since these names would error
by default. Therefore, add an exception if the provided name is in the
dummy model names (which also doubles as inline strict exceptions).

However, the dummy model names weren't configurable, so add a new
option to specify exception names, otherwise the default is gpt-3.5-turbo.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-11-17 21:15:45 -05:00
..
types Model: Remove override_base_seq_len 2024-10-30 10:03:08 +08:00
utils API: Add inline exception for dummy models 2024-11-17 21:15:45 -05:00
router.py API: Add inline exception for dummy models 2024-11-17 21:15:45 -05:00