jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Simplify add_bos_token handling

Browse source 
Set add_bos_token to True by default in the tokenizer_config stub.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-05-02 21:30:18 -04:00
parent 4cb3e5d5b1
commit 242f6b7d2a
3 changed files with 6 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/transformers_utils.py
View file

@ -60,7 +60,7 @@ class TokenizerConfig(BaseModel):
An abridged version of HuggingFace's tokenizer config.
"""
add_bos_token: Optional[bool] = None
add_bos_token: Optional[bool] = True
@classmethod
async def from_file(cls, model_directory: pathlib.Path):