Model: Add BOS token to prompt logs
If add_bos_token is enabled, the BOS token gets appended to the logged prompt if logging is enabled. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
parent
96fce34253
commit
10d9419f90
1 changed files with 6 additions and 2 deletions
|
|
@ -1163,8 +1163,12 @@ class ExllamaV2Container:
|
|||
# This is an inverse of skip_special_tokens
|
||||
decode_special_tokens = unwrap(not kwargs.get("skip_special_tokens"), False)
|
||||
|
||||
# Log prompt to console
|
||||
log_prompt(prompt, request_id, negative_prompt)
|
||||
# Log prompt to console. Add the BOS token if specified
|
||||
log_prompt(
|
||||
f"{self.tokenizer.bos_token if add_bos_token else ''}{prompt}",
|
||||
request_id,
|
||||
negative_prompt
|
||||
)
|
||||
|
||||
# Create and add a new job
|
||||
# Don't use the request ID here as there can be multiple jobs per request
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue