Update README
Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
parent
e46676cb08
commit
63762654f0
1 changed files with 15 additions and 1 deletions
16
README.md
16
README.md
|
|
@ -76,7 +76,7 @@ TabbyAPI uses an API key and admin key to authenticate a user's request. On firs
|
|||
|
||||
If you feel that the keys have been compromised, delete `api_tokens.yml` and the API will generate new keys for you.
|
||||
|
||||
API keys and admin keys can be provided via:
|
||||
API keys and admin keys can be provided via the following request headers:
|
||||
|
||||
- `x-api-key` and `x-admin-key` respectively
|
||||
|
||||
|
|
@ -98,6 +98,20 @@ All routes require an API key except for the following which require an **admin*
|
|||
|
||||
- See [#5](https://github.com/theroyallab/tabbyAPI/issues/5)
|
||||
|
||||
- Exllamav2 may error with the following exception: `ImportError: DLL load failed while importing exllamav2_ext: The specified module could not be found.`
|
||||
|
||||
- First, make sure to check if the wheel is equivalent to your python version and CUDA version. Also make sure you're in a venv or conda environment.
|
||||
|
||||
- If those prerequisites are correct, the torch cache may need to be cleared. This is due to a mismatching exllamav2_ext.
|
||||
|
||||
- In Windows: Find the cache at `C:\Users\<User>\AppData\Local\torch_extensions\torch_extensions\Cache` where `<User>` is your Windows username
|
||||
|
||||
- In Linux: Find the cache at `~/.cache/torch_extensions`
|
||||
|
||||
- look for any folder named `exllamav2_ext` in the python subdirectories and delete them.
|
||||
|
||||
- Restart TabbyAPI and launching should work again.
|
||||
|
||||
## Contributing
|
||||
|
||||
If you have issues with the project:
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue