kingbri 2a33ebbf29 Model: Bypass lock checks when shutting down ... Previously, when a SIGINT was emitted and a model load is running, the API didn't shut down until the load finished due to waitng for the lock. However, when shutting down, the lock doesn't matter since the process is being killed anyway. Signed-off-by: kingbri <bdashore3@proton.me>		2024-08-03 16:05:34 -04:00
..
exllamav2	Model: Bypass lock checks when shutting down	2024-08-03 16:05:34 -04:00
infinity	Embeddings: Update config, args, and parameter names	2024-07-30 15:32:26 -04:00