tabbyAPI-ollama/sampler_overrides
kingbri fc4570220c API + Model: Add new parameters and clean up documentation
The example JSON fields were changed because of the new sampler
default strategy. Fix these by manually changing the values.

Also add support for fasttensors and expose generate_window to
the API. It's recommended to not adjust generate_window as it's
dynamically scaled based on max_seq_len by default.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-01-25 00:15:40 -05:00
..
sample_preset.yml API + Model: Add new parameters and clean up documentation 2024-01-25 00:15:40 -05:00