jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Fix logit bias handling

Browse source 
If the token doesn't exist, gracefully warn instead of erroring out.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-02-18 18:30:58 -05:00
parent aa34b2e5fd
commit 7def32e4de
2 changed files with 8 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/sampling.py
View file

@ -111,7 +111,7 @@ class BaseSamplerRequest(BaseModel):
logit_bias: Optional[Dict[int, float]] = Field(
default_factory=lambda: get_default_sampler_value("logit_bias"),
examples=[[{"1": 10}]],
examples=[{"1": 10, "2": 50}],
)
negative_prompt: Optional[str] = Field(