jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Samplers: Expose skew sampling

Browse source 
Skew is an extra unused sampler in ExllamaV2. Add it in for coverage.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-05-12 01:41:01 -04:00
parent 6f4012d20d
commit c8ec742be9
3 changed files with 10 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
sampler_overrides/sample_preset.yml
View file

@ -73,6 +73,9 @@ tfs:
typical:
override: 1.0
force: false
skew:
override: 0.0
force: false
# MARK: Penalty settings
frequency_penalty: