jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Expose draft_rope_scale

Browse source
This commit is contained in:
DocShotgun 2023-12-05 12:59:32 -08:00 • committed by GitHub
parent e085b806e8
commit 39f7a2aabd
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 7 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

1
config_sample.yml
View file

@ -58,4 +58,5 @@ model:
draft_model_name: A model name
# Rope parameters for draft models (default: 1.0)
draft_rope_scale: 1.0
draft_rope_alpha: 1.0