tabbyAPI-ollama/common
kingbri 879f4cee7e API: Modify tool calling for wider compat
When revisiting tool calls, the formats have more or less become standard.
For greater compatibility with templates, primarily use the message.tools
parameter and remove the extra custom metadata that is no longer required.

However, unlike other backends, tabbyAPI still uses template metadata
to declare what the tool start string is. This allows for template-level
customization along with giving more power to the user while the server
exists to consume rather than work on a case-by-case basis.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-07-05 14:28:12 -04:00
..
actions.py Downloader: log errors when downloading 2025-02-19 23:16:17 -05:00
args.py Args: Expose api-servers to subcommands 2025-02-10 23:39:46 -05:00
auth.py Tree: Format 2024-09-18 20:36:17 -04:00
concurrency.py API + Model: Add blocks and checks for various load requests 2024-05-25 21:16:14 -04:00
config_models.py Model: Default max_seq_len to 4096 2025-06-13 14:57:24 -04:00
downloader.py Downloader: Switch to use API sizes 2025-06-30 12:49:53 -04:00
gen_logging.py API: Add timings to usage stats 2025-06-17 22:54:51 -04:00
hardware.py Common: Add hardware file 2025-05-02 21:33:25 -04:00
health.py Add health check monitoring for EXL2 errors (#206) 2024-09-22 21:40:36 -04:00
image_util.py Common: Refactor get_image to common functions 2025-06-15 19:20:36 +02:00
logger.py FIx logs path 2025-04-22 21:14:45 -04:00
model.py API + Model: Fix application of defaults 2025-07-03 14:37:34 -04:00
multimodal.py Tree: Format 2025-06-15 19:33:14 +02:00
networking.py remove unused imports 2024-09-11 18:00:29 +01:00
optional_dependencies.py Dependencies: Fix unsupported dependency error 2025-06-13 14:57:02 -04:00
sampling.py Sampling: Make add_bos_token override concise 2025-05-10 19:07:35 -04:00
signals.py Signals: Split signal handler between sync and async 2024-09-19 23:31:29 -04:00
tabby_config.py API + Model: Fix application of defaults 2025-07-03 14:37:34 -04:00
templating.py API: Modify tool calling for wider compat 2025-07-05 14:28:12 -04:00
transformers_utils.py Model: Default max_seq_len to 4096 2025-06-13 14:57:24 -04:00
utils.py Config: Deep merge model overrides 2025-07-03 12:17:09 -04:00