kingbri 9f649647f0 Model + API: GPU split updates and fixes ... For the TP loader, GPU split cannot be an empty array. However, defaulting the parameter to an empty array makes it easier to calculate the device list. Therefore, cast an empty array to None using falsy comparisons at load time. Also add draft_gpu_split to the load request. Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>		2025-02-15 21:50:14 -05:00
..
types	Model + API: GPU split updates and fixes	2025-02-15 21:50:14 -05:00
utils	API: Add inline exception for dummy models	2024-11-17 21:15:45 -05:00
router.py	Endpoints: Add props endpoint and add more values to model params	2024-12-26 17:32:19 -05:00