jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

API: Let the user know if a disconnect occurred

Browse source 
If a user disconnects from a request, log this in the console.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-03-09 15:47:46 -05:00
parent c77259bfbb
commit a69ee976f0
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
main.py
View file

@ -522,6 +522,7 @@ async def generate_completion(request: Request, data: CompletionRequest):
)
for generation in new_generation:
if await request.is_disconnected():
logger.error("Completion generation cancelled by user.")
break
response = create_completion_response(generation, model_path.name)
@ -620,6 +621,7 @@ async def generate_chat_completion(request: Request, data: ChatCompletionRequest
)
for generation in new_generation:
if await request.is_disconnected():
logger.error("Chat completion generation cancelled by user.")
break
response = create_chat_completion_stream_chunk(