jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Config: Enable safe sampler overrides by default

Browse source 
* Provides safe fallback samplers, intended for better out-of-the-box support for clients that do not pass sampler params
This commit is contained in:
DocShotgun 2025-08-18 12:32:28 -07:00
parent a4d02c2b70
commit 998abe5ad1
4 changed files with 20 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

7
common/config_models.py
View file

@ -406,10 +406,13 @@ class SamplingConfig(BaseConfigModel):
override_preset: Optional[str] = Field(
None,
description=(
"Select a sampler override preset (default: None).\n"
"Select a sampler override preset (default: safe_defaults).\n"
"Find this in the sampler-overrides folder.\n"
"This overrides default fallbacks for sampler values "
"that are passed to the API."
"that are passed to the API.\n"
"NOTE: safe_defaults preset provides a fallback for frontends "
"that do not pass sampling params.\n"
"Remove it if not necessary."
),
)