Config: Remove developement flag from tensor parallel

Exists in stable ExllamaV2 version.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-08-22 14:13:35 -04:00 committed by Brian Dashore
parent 565b0300d6
commit 364032e39e

View file

@ -112,7 +112,6 @@ model:
# Load model with tensor parallelism
# If a GPU split isn't provided, the TP loader will fallback to autosplit
# Enabling ignores the gpu_split_auto and autosplit_reserve values
# NOTE: Requires a development build of exllamav2
#tensor_parallel: False
# Automatically allocate resources to GPUs (default: True)