kingbri 43f9483bc4 Model: Add tensor_parallel_backend option ... This allows for users to use nccl or native depending on the GPU setup. NCCL is only available with Linux built wheels. Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>		2025-08-17 22:35:10 -04:00
..
types	Model: Add tensor_parallel_backend option	2025-08-17 22:35:10 -04:00
utils	API + Model: Fix application of defaults	2025-07-03 14:37:34 -04:00
router.py	API + Model: Fix application of defaults	2025-07-03 14:37:34 -04:00