kingbri e00eb09ef3 OAI: Add cancellation with inline load ... When the request is cancelled, cancel the load task. In addition, when checking if a model container exists, also check if the model is fully loaded. Signed-off-by: kingbri <bdashore3@proton.me>		2024-09-11 00:08:55 -04:00
..
chat_completion.py	Remove rouge print statements within chat_completion.py (#174)	2024-08-23 21:28:37 -04:00
completion.py	OAI: Add cancellation with inline load	2024-09-11 00:08:55 -04:00
embeddings.py	Embeddings: Migrate and organize Infinity	2024-07-30 11:00:23 -04:00