3605067898
Pytorch released 2.2 without letting the community know first. Pin the torch version to 2.1.2 until exllamav2 builds for torch 2.2 Signed-off-by: kingbri <bdashore3@proton.me>
17 lines
520 B
Text
17 lines
520 B
Text
# Torch
|
|
# Patch until torch 2.2 is supported
|
|
--extra-index-url https://download.pytorch.org/whl/rocm5.6
|
|
torch < 2.2, >= 2
|
|
|
|
# Exllamav2
|
|
https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp311-cp311-linux_x86_64.whl; python_version == "3.11"
|
|
https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp310-cp310-linux_x86_64.whl; python_version == "3.10"
|
|
|
|
# Pip dependencies
|
|
fastapi
|
|
pydantic >= 2.0.0
|
|
PyYAML
|
|
progress
|
|
uvicorn
|
|
jinja2 >= 3.0.0
|
|
colorlog
|