jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Additional clarification for override_base_seq_len

Browse source
This commit is contained in:
DocShotgun 2024-03-02 09:29:50 -08:00 • committed by GitHub
parent fc857893ee
commit 8245488926
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

3
config_sample.yml
View file

@ -73,7 +73,8 @@ model:
# Overrides base model context length (default: Empty)
# WARNING: Don't set this unless you know what you're doing!
# Only use this if the model's base sequence length in config.json is incorrect (ex. Mistral/Mixtral models)
# Again, do NOT use this for configuring context length, use max_seq_len above ^
# Only use this if the model's base sequence length in config.json is incorrect (ex. Mistral 7B)
#override_base_seq_len:
# Automatically allocate resources to GPUs (default: True)