Config: Remove developement flag from tensor parallel
Exists in stable ExllamaV2 version. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
parent
565b0300d6
commit
364032e39e
1 changed files with 0 additions and 1 deletions
|
|
@ -112,7 +112,6 @@ model:
|
|||
# Load model with tensor parallelism
|
||||
# If a GPU split isn't provided, the TP loader will fallback to autosplit
|
||||
# Enabling ignores the gpu_split_auto and autosplit_reserve values
|
||||
# NOTE: Requires a development build of exllamav2
|
||||
#tensor_parallel: False
|
||||
|
||||
# Automatically allocate resources to GPUs (default: True)
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue