jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Docs: Update getting started with downloading from private repos

Browse source 
Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri 2025-03-19 12:02:48 -04:00
parent 529c90b93e
commit ccf23243c1
1 changed files with 4 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/01.-Getting-Started.md
View file

@ -63,6 +63,10 @@ Example with Turboderp's Llama 3.1 8B quants:
`.\Start.bat download turboderp/Qwen2.5-VL-7B-Instruct-exl2 --revision 4.0bpw`
If a model is gated, you can provide a HuggingFace access token (most exl2 quants aren't private):
`.\Start.bat download meta-llama/Llama-3.1-8B --token <token>`
Alternatively, running `main.py` directly can also trigger the downloader. For additional options, run `.\Start.bat download --help`
## Configuration