jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Config: Enable safe sampler overrides by default

Browse source 
* Provides safe fallback samplers, intended for better out-of-the-box support for clients that do not pass sampler params
This commit is contained in:
DocShotgun 2025-08-18 12:32:28 -07:00
parent a4d02c2b70
commit 998abe5ad1
4 changed files with 20 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

6
config_sample.yml
View file

@ -208,10 +208,12 @@ embeddings:
# Options for Sampling
sampling:
# Select a sampler override preset (default: None).
# Select a sampler override preset (default: safe_defaults).
# Find this in the sampler-overrides folder.
# This overrides default fallbacks for sampler values that are passed to the API.
override_preset:
# NOTE: safe_defaults preset provides a fallback for frontends that do not pass sampling params.
# Remove it if not necessary.
override_preset: safe_defaults
# Options for development and experimentation
developer: