jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Cast penalty range to int

Browse source
This commit is contained in:
turboderp 2025-05-03 22:28:36 +02:00
parent 58c380b8ca
commit 0405a94a89
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
backends/exllamav3/model.py
View file

@ -680,7 +680,7 @@ class ExllamaV3Container(BaseModelContainer):
# Exl3's version of including the entire context
if penalty_range < 0:
penalty_range = 10e7
penalty_range = int(10e7)
# Always make sure the fallback is 0 if range < 0
# It's technically fine to use -1, but this just validates the passed