Docs: Update sampler overrides
Change the sampling subsection to sampler overrides and add a warning about the default preset. Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
parent
067d63773e
commit
e07df3951e
2 changed files with 3 additions and 0 deletions
|
|
@ -76,6 +76,9 @@ A config.yml file is required for overriding project defaults. **If you are okay
|
|||
|
||||
If you do want a config file, copy over `config_sample.yml` to `config.yml`. All the fields are commented, so make sure to read the descriptions and comment out or remove fields that you don't need.
|
||||
|
||||
> [!WARNING]
|
||||
> Due to frontends not sending sampler settings per request, tabbyAPI sets a safe defaults sampler override in config_sample.yml. If you are testing metrics or experimenting, please remove `safe_defaults` from the `override_preset` key!
|
||||
|
||||
In addition, if you want to manually set the API keys, copy over `api_keys_sample.yml` to `api_keys.yml` and fill in the fields. However, doing this is less secure and autogenerated keys should be used instead.
|
||||
|
||||
You can also access the configuration parameters under [2. Configuration](https://github.com/theroyallab/tabbyAPI/wiki/2.-Configuration) in this wiki!
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue