kingbri 5c082b7e8c Async: Add option to use Uvloop/Winloop ... These are faster event loops for asyncio which should improve overall performance. Gate these under an experimental flag for now to stress test these loops. Signed-off-by: kingbri <bdashore3@proton.me>		2024-07-24 18:59:20 -04:00
..
args.py	Async: Add option to use Uvloop/Winloop	2024-07-24 18:59:20 -04:00
auth.py	Auth: Fix key check coalesce	2024-07-19 10:08:57 -04:00
concurrency.py	API + Model: Add blocks and checks for various load requests	2024-05-25 21:16:14 -04:00
config.py	API: Add request logging	2024-07-22 21:40:00 -04:00
downloader.py	Downloader: Make timeout configurable	2024-07-23 21:42:38 -04:00
gen_logging.py	API: Add ability to use request IDs	2024-07-21 21:01:05 -04:00
logger.py	API: Add HuggingFace downloader	2024-04-29 01:15:02 -04:00
model.py	OAI: Migrate model depends into proper file	2024-07-23 13:59:56 -04:00
networking.py	API: Add request logging	2024-07-22 21:40:00 -04:00
sampling.py	Tree: Swap from map to list comprehensions	2024-05-25 21:16:14 -04:00
signals.py	Signal: Fix signal handlers for uvicorn	2024-03-16 23:23:31 -04:00
templating.py	Templates: Migrate to class	2024-04-21 23:28:14 -04:00
transformers_utils.py	Tree: Add transformers_utils	2024-04-20 00:07:39 -04:00
utils.py	Sampling: Copy over iterable overrides	2024-05-17 21:38:28 -04:00