tabbyAPI-ollama/common
kingbri 7bf2b07d4c Signals: Exit on async cleanup
The async signal exit function should be the internal for exiting
the program. In addition, prevent the handler from being called
twice by adding a boolean. May become an asyncio event later on.

In addition, make sure to skip_wait when running model.unload.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-08-02 15:11:57 -04:00
..
args.py Embeddings: Update config, args, and parameter names 2024-07-30 15:32:26 -04:00
auth.py Auth: Fix disable auth when checking for key permissions 2024-07-26 15:04:29 -04:00
concurrency.py API + Model: Add blocks and checks for various load requests 2024-05-25 21:16:14 -04:00
config.py Embeddings: Update config, args, and parameter names 2024-07-30 15:32:26 -04:00
downloader.py Downloader: Make timeout configurable 2024-07-23 21:42:38 -04:00
gen_logging.py Model: Attach request ID to logs 2024-08-01 00:25:54 -04:00
logger.py API: Add HuggingFace downloader 2024-04-29 01:15:02 -04:00
model.py Config: Embeddings: Make embeddings_device a default when API loading 2024-08-01 13:59:49 -04:00
networking.py API: Add request logging 2024-07-22 21:40:00 -04:00
sampling.py Tree: Format 2024-07-26 18:33:04 -04:00
signals.py Signals: Exit on async cleanup 2024-08-02 15:11:57 -04:00
templating.py Templates: Migrate to class 2024-04-21 23:28:14 -04:00
transformers_utils.py Tree: Format 2024-07-26 18:33:04 -04:00
utils.py Model: Add support for HuggingFace config and bad_words_ids 2024-07-26 18:23:22 -04:00