kingbri 27d2d5f3d2 Config + Model: Allow for default fallbacks from config for model loads ... Previously, the parameters under the "model" block in config.yml only handled the loading of a model on startup. This meant that any subsequent API request required each parameter to be filled out or use a sane default (usually defaults to the model's config.json). However, there are cases where admins may want an argument from the config to apply if the parameter isn't provided in the request body. To help alleviate this, add a mechanism that works like sampler overrides where users can specify a flag that acts as a fallback. Therefore, this change both preserves the source of truth of what parameters the admin is loading and adds some convenience for users that want customizable defaults for their requests. This behavior may change in the future, but I think it solves the issue for now. Signed-off-by: kingbri <bdashore3@proton.me>		2024-07-06 17:50:58 -04:00
..
OAI	Config + Model: Allow for default fallbacks from config for model loads	2024-07-06 17:50:58 -04:00
server.py	API: Move OAI to APIRouter	2024-04-06 01:25:31 -04:00