jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Config: Change default dirs in sample

Browse source 
Models and draft models default to the models directory while
loras default to the loras directory.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2023-12-21 22:28:48 -05:00
parent 87a9dfc8c4
commit 72e19dbc12
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
config_sample.yml
View file

@ -25,7 +25,7 @@ logging:
model:
# Overrides the directory to look for models (default: models)
# Windows users, DO NOT put this path in quotes! This directory will be invalid otherwise.
model_dir: your model directory path
model_dir: models
# An initial model to load. Make sure the model is located in the model directory!
# A model can be loaded later via the API.
@ -80,7 +80,7 @@ model:
# Options for draft models (speculative decoding). This will use more VRAM!
draft:
# Overrides the directory to look for draft (default: models)
draft_model_dir: Your draft model directory path
draft_model_dir: models
# An initial draft model to load. Make sure this model is located in the model directory!
# A draft model can be loaded later via the API.
@ -99,7 +99,7 @@ model:
# Options for loras
lora:
# Overrides the directory to look for loras (default: loras)
lora_dir: Your lora directory path
lora_dir: loras
# List of loras to load and associated scaling factors (default: 1.0). Comment out unused entries or add more rows as needed.
loras: