kingbri 43f9483bc4 Model: Add tensor_parallel_backend option ... This allows for users to use nccl or native depending on the GPU setup. NCCL is only available with Linux built wheels. Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>		2025-08-17 22:35:10 -04:00
..
exllamav2	API: Persist request IDs and append full_text to finish chunk	2025-07-25 12:27:44 -04:00
exllamav3	Model: Add tensor_parallel_backend option	2025-08-17 22:35:10 -04:00
infinity	Model: Add proper jobs cleanup and fix var calls	2025-04-24 21:30:55 -04:00
base_model_container.py	Model: Create universal HFModel class	2025-05-13 18:12:38 -04:00