a10c14d357
YAML is a more flexible format when it comes to configuration. Commandline arguments are difficult to remember and configure especially for an API with complicated commandline names. Rather than using half-baked textfiles, implement a proper config solution. Also add a progress bar when loading models in the commandline. Signed-off-by: kingbri <bdashore3@proton.me>
8 lines
167 B
YAML
8 lines
167 B
YAML
model_dir: "D:/models"
|
|
model_name: "this_is_a_exl2_model"
|
|
max_seq_len: 4096
|
|
gpu_split: "auto"
|
|
rope_scale: 1.0
|
|
rope_alpha: 1.0
|
|
no_flash_attention: False
|
|
low_mem: False
|