jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Samplers: Add dynamic temperature

Browse source 
Does not work if max_temp is less than or equal to min_temp. Sampler
validation will have to be refactored in the future, so the dynamic
temperature check will also be changed.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-01-31 01:20:59 -05:00
parent 3605067898
commit 4a7b8b1b7a
3 changed files with 50 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
sampler_overrides/sample_preset.yml
View file

@ -30,6 +30,15 @@ temperature:
temperature_last:
override: false
force: false
min_temp:
override: 0.0
force: false
max_temp:
override: 0.0
force: false
temp_exponent:
override: 0.0
force: false
# MARK: Alphabet soup
top_k: