jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Samplers: Minor fixes for sampler override

Browse source 
* Add missing settings to sample_preset.yml
* Fix override for skip_special_tokens
This commit is contained in:
DocShotgun 2024-05-12 00:31:31 -07:00
parent c8ec742be9
commit 9463ecfa40
2 changed files with 8 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/sampling.py
View file

@ -121,7 +121,7 @@ class BaseSamplerRequest(BaseModel):
)
skip_special_tokens: Optional[bool] = Field(
default_factory=lambda: get_default_sampler_value("ban_eos_token", True),
default_factory=lambda: get_default_sampler_value("skip_special_tokens", True),
examples=[True],
)