jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Dependencies: Change handling of exllamav2 checks

Browse source 
ExllamaV2 should check for solely exllamav2, otherwise errors don't
make sense. Migrate the combined "exl2" computed property to "inference"
since those are the required dependencies for minimal inference.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-09-22 12:57:28 -04:00
parent 5380b3fe5e
commit e0ffa90865
3 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/model.py
View file

@ -15,7 +15,7 @@ from common.networking import handle_request_error
from common.tabby_config import config
from common.optional_dependencies import dependencies
if dependencies.exl2:
if dependencies.exllamav2:
from backends.exllamav2.model import ExllamaV2Container
# Global model container