eee8b642bd
Add support for /v1/completions with the option to use streaming if needed. Also rewrite API endpoints to use async when possible since that improves request performance. Model container parameter names also needed rewrites as well and set fallback cases to their disabled values. Signed-off-by: kingbri <bdashore3@proton.me>
4 lines
78 B
Text
4 lines
78 B
Text
fastapi
|
|
PyYAML
|
|
progress
|
|
sse_starlette
|