jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
tabbyAPI-ollama/common
History
kingbri 2a33ebbf29 Model: Bypass lock checks when shutting down 
Previously, when a SIGINT was emitted and a model load is running,
the API didn't shut down until the load finished due to waitng for
the lock. However, when shutting down, the lock doesn't matter since
the process is being killed anyway.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-08-03 16:05:34 -04:00
..
args.py Embeddings: Update config, args, and parameter names 2024-07-30 15:32:26 -04:00
auth.py Auth: Fix disable auth when checking for key permissions 2024-07-26 15:04:29 -04:00
concurrency.py API + Model: Add blocks and checks for various load requests 2024-05-25 21:16:14 -04:00
config.py Embeddings: Update config, args, and parameter names 2024-07-30 15:32:26 -04:00
downloader.py Downloader: Make timeout configurable 2024-07-23 21:42:38 -04:00
gen_logging.py Model: Attach request ID to logs 2024-08-01 00:25:54 -04:00
logger.py API: Add HuggingFace downloader 2024-04-29 01:15:02 -04:00
model.py Model: Bypass lock checks when shutting down 2024-08-03 16:05:34 -04:00
networking.py API: Add request logging 2024-07-22 21:40:00 -04:00
sampling.py Tree: Format 2024-07-26 18:33:04 -04:00
signals.py Model: Bypass lock checks when shutting down 2024-08-03 16:05:34 -04:00
templating.py Templates: Migrate to class 2024-04-21 23:28:14 -04:00
transformers_utils.py Tree: Format 2024-07-26 18:33:04 -04:00
utils.py Model: Add support for HuggingFace config and bad_words_ids 2024-07-26 18:23:22 -04:00