jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fixup: autosplit reserve

Browse source 
this probably breaks v2 support
This commit is contained in:
randoentity 2025-04-30 09:43:33 +02:00 • committed by kingbri
parent acb3adb953
commit 306fc7cd15
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/config_models.py
View file

@ -193,7 +193,7 @@ class ModelConfig(BaseConfigModel):
"Not parsed for single GPU users."
),
)
autosplit_reserve: List[int] = Field(
autosplit_reserve: List[float] = Field(
[96],
description=(
"Reserve VRAM used for autosplit loading (default: 96 MB on GPU 0).\n"