fc4570220c
The example JSON fields were changed because of the new sampler default strategy. Fix these by manually changing the values. Also add support for fasttensors and expose generate_window to the API. It's recommended to not adjust generate_window as it's dynamically scaled based on max_seq_len by default. Signed-off-by: kingbri <bdashore3@proton.me> |
||
|---|---|---|
| .. | ||
| args.py | ||
| auth.py | ||
| config.py | ||
| gen_logging.py | ||
| generators.py | ||
| logger.py | ||
| sampling.py | ||
| templating.py | ||
| utils.py | ||