kingbri 42c0dbe795 Generation: Explicitly release semaphore on disconnect ... This prevents any lockups when querying another request. Signed-off-by: kingbri <bdashore3@proton.me>		2024-03-10 17:54:48 -04:00
..
args.py	Config: Add experimental torch cuda malloc backend	2024-02-14 21:45:56 -05:00
auth.py	Logging: Switch to loguru	2024-03-08 01:00:48 -05:00
config.py	Logging: Switch to loguru	2024-03-08 01:00:48 -05:00
gen_logging.py	Logging: Switch to loguru	2024-03-08 01:00:48 -05:00
generators.py	Generation: Explicitly release semaphore on disconnect	2024-03-10 17:54:48 -04:00
logger.py	Logging: Loglevel INFO	2024-03-10 17:44:19 -04:00
sampling.py	Logging: Switch to loguru	2024-03-08 01:00:48 -05:00
templating.py	API: Add template switching and unload endpoints	2024-01-25 00:15:40 -05:00
utils.py	API: Fix disconnect handling on streaming responses	2024-03-10 17:43:13 -04:00