jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Startup: Check agnostically for inference deps

Browse source 
If an inference dep isn't present, force exit the application. This
occurs after all subcommands have been appropriately processed.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-05-09 21:59:00 -04:00
parent 33ac016023
commit 48ea1737cf
2 changed files with 17 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/optional_dependencies.py
View file

@ -26,7 +26,7 @@ class DependenciesModel(BaseModel):
@computed_field
@property
def inference(self) -> bool:
return self.torch and (self.exllamav2 or self.exllamav3) and self.flash_attn
return self.torch and (self.exllamav2 or (self.exllamav3 and self.flash_attn))
def is_installed(package_name: str) -> bool: