jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update documentation

Browse source 
Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2023-12-05 00:33:43 -05:00
parent 8ba3bfa6b3
commit 621e11b940
2 changed files with 2 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
README.md
View file

@ -18,9 +18,9 @@ To get started, make sure you have the following installed on your system:
- Python 3.x (preferably 3.11) with pip
- CUDA 12.1 or 11.8 (or ROCm 5.6)
- CUDA 12.x (you can also use CUDA 11.8 or ROCm 5.6, but there will be more work required to install dependencies such as Flash Attention 2)
NOTE: For Flash Attention 2 to work on Windows, CUDA 12.1 **must** be installed!
NOTE: For Flash Attention 2 to work on Windows, CUDA 12.x **must** be installed!
## Installing