tabbyAPI-ollama/common
kingbri f070587e9f Model: Add proper jobs cleanup and fix var calls
Jobs should be started and immediately cleaned up when calling the
generation stream. Expose a stream_generate function and append
this to the base class since it's more idiomatic than generate_gen.

The exl2 container's generate_gen function is now internal.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-04-24 21:30:55 -04:00
..
actions.py Downloader: log errors when downloading 2025-02-19 23:16:17 -05:00
args.py Args: Expose api-servers to subcommands 2025-02-10 23:39:46 -05:00
auth.py Tree: Format 2024-09-18 20:36:17 -04:00
concurrency.py API + Model: Add blocks and checks for various load requests 2024-05-25 21:16:14 -04:00
config_models.py Tree: Format and lint 2025-03-19 11:55:02 -04:00
downloader.py Downloader: log errors when downloading 2025-02-19 23:16:17 -05:00
gen_logging.py Logging: Remove preferences global 2024-09-14 21:49:44 -04:00
health.py Add health check monitoring for EXL2 errors (#206) 2024-09-22 21:40:36 -04:00
logger.py Logger: Switch to ISO timestamp formatting 2025-02-19 21:48:23 -05:00
model.py Model: Add proper jobs cleanup and fix var calls 2025-04-24 21:30:55 -04:00
multimodal.py Tree: Format 2025-02-07 18:03:33 -05:00
networking.py remove unused imports 2024-09-11 18:00:29 +01:00
optional_dependencies.py Dependencies: Remove outlines from optional check 2024-12-18 11:56:40 -05:00
sampling.py Model: Remove generate_window 2025-04-16 12:59:02 -04:00
signals.py Signals: Split signal handler between sync and async 2024-09-19 23:31:29 -04:00
tabby_config.py Cleanup config file loader (#208) 2024-09-23 21:42:01 -04:00
templating.py Tree: Format 2025-04-21 23:21:26 -04:00
transformers_utils.py Refactor the sampling class (#199) 2024-10-27 11:43:41 -04:00
utils.py Fix RoPE Ratio 2025-04-21 01:46:18 +02:00