DocShotgun 767e6a798a API + Model: Add support for specifying k/v cache size		2024-05-26 14:17:01 -07:00
..
args.py	API + Model: Add support for specifying k/v cache size	2024-05-26 14:17:01 -07:00
auth.py	API: Cleanup permission endpoint	2024-03-18 15:13:26 -04:00
concurrency.py	API + Model: Add blocks and checks for various load requests	2024-05-25 21:16:14 -04:00
config.py	Tree: Update to cleanup globals	2024-03-12 23:59:30 -04:00
downloader.py	Tree: Swap from map to list comprehensions	2024-05-25 21:16:14 -04:00
gen_logging.py	Model: Use true async jobs and add logprobs	2024-05-25 21:16:14 -04:00
logger.py	API: Add HuggingFace downloader	2024-04-29 01:15:02 -04:00
model.py	API + Model: Add blocks and checks for various load requests	2024-05-25 21:16:14 -04:00
networking.py	Concurrency: Remove release_semaphore method	2024-05-19 10:42:26 -04:00
sampling.py	Tree: Swap from map to list comprehensions	2024-05-25 21:16:14 -04:00
signals.py	Signal: Fix signal handlers for uvicorn	2024-03-16 23:23:31 -04:00
templating.py	Templates: Migrate to class	2024-04-21 23:28:14 -04:00
transformers_utils.py	Tree: Add transformers_utils	2024-04-20 00:07:39 -04:00
utils.py	Sampling: Copy over iterable overrides	2024-05-17 21:38:28 -04:00