jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Fix log if exl2 version is too low

Browse source 
Switch to pyproject syntax.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-03-31 23:11:21 -04:00
parent f534930270
commit 6ecce1604b
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
backends/exllamav2/utils.py
View file

@ -18,11 +18,11 @@ def check_exllama_version():
"Or you can manually run a requirements update "
"using the following command:\n\n"
"For CUDA 12.1:\n"
"pip install --upgrade -r requirements.txt\n\n"
"pip install --upgrade .[cu121]\n\n"
"For CUDA 11.8:\n"
"pip install --upgrade -r requirements-cu118.txt\n\n"
"pip install --upgrade .[cu118]\n\n"
"For ROCm:\n"
"pip install --upgrade -r requirements-amd.txt\n\n"
"pip install --upgrade .[amd]\n\n"
)
else:
logger.info(f"ExllamaV2 version: {current_version}")