jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Add prompt logging to ExllamaV3

Browse source 
Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-05-17 21:39:41 -04:00
parent 729caaeddc
commit 0c4cc1eba3
2 changed files with 8 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/gen_logging.py
View file

@ -29,7 +29,7 @@ def log_generation_params(**kwargs):
logger.info(f"Generation options: {kwargs}\n")
def log_prompt(prompt: str, request_id: str, negative_prompt: Optional[str]):
def log_prompt(prompt: str, request_id: str, negative_prompt: Optional[str] = None):
"""Logs the prompt to console."""
if config.logging.log_prompt:
formatted_prompt = "\n" + prompt