jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
tabbyAPI-ollama/OAI
History
kingbri b625bface9 OAI: Add API-based model loading/unloading and auth routes 
Models can be loaded and unloaded via the API. Also add authentication
to use the API and for administrator tasks.

Both types of authorization use different keys.

Also fix the unload function to properly free all used vram.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-11-14 01:17:19 -05:00
..
types OAI: Add API-based model loading/unloading and auth routes 2023-11-14 01:17:19 -05:00
utils.py OAI: Add API-based model loading/unloading and auth routes 2023-11-14 01:17:19 -05:00