jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Sample config: Remove unused value

Browse source 
Draft models are specified in the draft sublock.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2023-11-19 01:16:03 -05:00
parent e0e93c103b
commit 581e1fc219
1 changed files with 0 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
config_sample.yml
View file

@ -23,10 +23,6 @@ model:
# A model can be loaded later via the API.
model_name: A model name
# Set the following to enable speculative decoding
# draft_model_dir: your model directory path to use as draft model (path is independent from model_dir)
draft_rope_alpha: 1.0 (default: the draft model's alpha value is calculated automatically to scale to the size of the full model.)
# The below parameters apply only if model_name is set
# Maximum model context length (default: 4096)