tabbyAPI-ollama/endpoints
kingbri 43cd7f57e8 API + Model: Add blocks and checks for various load requests
Add a sequential lock and wait until jobs are completed before executing
any loading requests that directly alter the model. However, we also
need to block any new requests that come in until the load is finished,
so add a condition that triggers once the lock is free.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-25 21:16:14 -04:00
..
OAI API + Model: Add blocks and checks for various load requests 2024-05-25 21:16:14 -04:00
server.py API: Move OAI to APIRouter 2024-04-06 01:25:31 -04:00