jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Remove extra unwraps

Browse source 
The base sampler request already specifies the defaults, so don't
unwrap in this way.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-04-15 23:38:46 -04:00
parent 11ed3cf5ee
commit dcb36e9ab2
2 changed files with 41 additions and 52 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/sampling.py
View file

@ -42,7 +42,7 @@ class BaseSamplerRequest(BaseModel):
)
generate_window: Optional[int] = Field(
default_factory=lambda: get_default_sampler_value("generate_window"),
default_factory=lambda: get_default_sampler_value("generate_window", 512),
examples=[512],
ge=0,
)