kingbri 57b3d69949 API + Model: Add support for JSON schema constraints ... Add the ability to constrain the return value of a model to be JSON. Built using the JSON schema standard to define the properties of what the model should return. This feature should be more accurate than using GBNF/EBNF to yield the same results due to the use of lmformatenforcer. GBNF/EBNF will be added in a different commit/branch. Signed-off-by: kingbri <bdashore3@proton.me>		2024-02-24 23:40:11 -05:00
..
args.py	Config: Add experimental torch cuda malloc backend	2024-02-14 21:45:56 -05:00
auth.py	Auth: Create keys on different exception	2024-02-04 01:56:42 -05:00
config.py	Launch: Make exllamav2 requirement more friendly	2024-02-02 23:36:17 -05:00
gen_logging.py	Tree: Refactor code organization	2024-01-25 00:15:40 -05:00
generators.py	Tree: Refactor code organization	2024-01-25 00:15:40 -05:00
logger.py	Tree: Refactor code organization	2024-01-25 00:15:40 -05:00
sampling.py	API + Model: Add support for JSON schema constraints	2024-02-24 23:40:11 -05:00
templating.py	API: Add template switching and unload endpoints	2024-01-25 00:15:40 -05:00
utils.py	Sampling: Cleanup and update	2024-02-02 23:36:17 -05:00