jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Sampling: Link dry_range

Browse source 
Was not linked in the gen params dict.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-09-08 01:55:00 -04:00
parent 0c74cd80ea
commit dffceab777
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
common/sampling.py
View file

@ -373,6 +373,7 @@ class BaseSamplerRequest(BaseModel):
"dry_base": self.dry_base,
"dry_allowed_length": self.dry_allowed_length,
"dry_sequence_breakers": self.dry_sequence_breakers,
"dry_range": self.dry_range,
"repetition_decay": self.repetition_decay,
"mirostat": self.mirostat_mode == 2,
"mirostat_tau": self.mirostat_tau,