jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Requirements: Don't use torch 2.2

Browse source 
Pytorch released 2.2 without letting the community know first. Pin
the torch version to 2.1.2 until exllamav2 builds for torch 2.2

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-01-29 23:30:10 -05:00
parent 751627e571
commit 3605067898
3 changed files with 6 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

3
requirements-amd.txt
View file

@ -1,6 +1,7 @@
# Torch
# Patch until torch 2.2 is supported
--extra-index-url https://download.pytorch.org/whl/rocm5.6
torch
torch < 2.2, >= 2
# Exllamav2
https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp311-cp311-linux_x86_64.whl; python_version == "3.11"

3
requirements-cu118.txt
View file

@ -1,6 +1,7 @@
# Torch
# Patch until torch 2.2 is supported
--extra-index-url https://download.pytorch.org/whl/cu118
torch
torch < 2.2, >= 2
# Exllamav2

3
requirements.txt
View file

@ -1,6 +1,7 @@
# Torch
# Patch until torch 2.2 is supported
--extra-index-url https://download.pytorch.org/whl/cu121
torch
torch < 2.2, >= 2
# Exllamav2