jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Start: Migrate options from cu121/118 to cu12

Browse source 
This encapsulates more cuda versions and makes install easier for
new users.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-08-19 22:25:30 -04:00
parent 1344726936
commit 30a3cd75cf
6 changed files with 35 additions and 41 deletions
Download patch file Download diff file Expand all files Collapse all files

2
colab/TabbyAPI_Colab_Example.ipynb
View file

@ -56,7 +56,7 @@
"%cd tabbyAPI\n",
"\n",
"# Install cuda requirements\n",
"!pip install .[cu121] -q\n",
"!pip install .[cu12] -q\n",
"!pip install huggingface-hub -q\n",
"\n",
"# Download cloudflared tunnel\n",