jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

API: Add request logging

Browse source 
Log all the parts of a request if the config flag is set. The logged
fields are all server side anyways, so nothing is being exposed to
clients.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-07-22 21:33:10 -04:00
parent 522999ebb4
commit 3826815edb
4 changed files with 61 additions and 28 deletions
Download patch file Download diff file Expand all files Collapse all files

4
config_sample.yml
View file

@ -31,6 +31,10 @@ logging:
# Enable generation parameter logging (default: False)
generation_params: False
# Enable request logging (default: False)
# NOTE: Only use this for debugging!
requests: False
# Options for sampling
sampling:
# Override preset name. Find this in the sampler-overrides folder (default: None)