jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
tabbyAPI-ollama/common
History
kingbri 2755fd1af0 API: Fix blocking iterator execution 
Run these iterators on the background thread. On startup, the API
spawns a background thread as needed to run sync code on without blocking
the event loop.

Use asyncio's run_thread function since it allows for errors to be
propegated.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-03-16 23:23:31 -04:00
..
args.py Tree: Format 2024-03-13 00:02:55 -04:00
auth.py Tree: Format 2024-03-13 00:02:55 -04:00
concurrency.py API: Fix blocking iterator execution 2024-03-16 23:23:31 -04:00
config.py Tree: Update to cleanup globals 2024-03-12 23:59:30 -04:00
gen_logging.py Tree: Format 2024-03-13 23:33:18 -04:00
logger.py Logging: Escape rich markup sequences 2024-03-11 00:28:48 -04:00
model.py API: Fix blocking iterator execution 2024-03-16 23:23:31 -04:00
sampling.py API + Model: Add speculative ngram decoding 2024-03-13 23:32:11 -04:00
templating.py Tree: Format 2024-03-13 00:02:55 -04:00
utils.py Tree: Switch to async generators 2024-03-16 23:23:31 -04:00