diff --git a/docs/01.-Getting-Started.md b/docs/01.-Getting-Started.md index 59a7674..c71413a 100644 --- a/docs/01.-Getting-Started.md +++ b/docs/01.-Getting-Started.md @@ -63,6 +63,10 @@ Example with Turboderp's Llama 3.1 8B quants: `.\Start.bat download turboderp/Qwen2.5-VL-7B-Instruct-exl2 --revision 4.0bpw` +If a model is gated, you can provide a HuggingFace access token (most exl2 quants aren't private): + +`.\Start.bat download meta-llama/Llama-3.1-8B --token ` + Alternatively, running `main.py` directly can also trigger the downloader. For additional options, run `.\Start.bat download --help` ## Configuration