kingbri 43cd7f57e8 API + Model: Add blocks and checks for various load requests ... Add a sequential lock and wait until jobs are completed before executing any loading requests that directly alter the model. However, we also need to block any new requests that come in until the load is finished, so add a condition that triggers once the lock is free. Signed-off-by: kingbri <bdashore3@proton.me>		2024-05-25 21:16:14 -04:00
..
chat_completion.py	Model: Use true async jobs and add logprobs	2024-05-25 21:16:14 -04:00
completion.py	Model: Use true async jobs and add logprobs	2024-05-25 21:16:14 -04:00
lora.py	Tree: Switch to async generators	2024-03-16 23:23:31 -04:00
model.py	API + Model: Add blocks and checks for various load requests	2024-05-25 21:16:14 -04:00