Model: Set vision load to False by default
Mistake in unwrapping. Vision should be false to allow normal model loading when the flag isn't provided. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
parent
902045edbb
commit
0ab393f09c
1 changed files with 1 additions and 1 deletions
|
|
@ -152,7 +152,7 @@ class ExllamaV2Container:
|
|||
kwargs = await self.set_model_overrides(**kwargs)
|
||||
|
||||
# Set vision state
|
||||
self.use_vision = unwrap(kwargs.get("vision"), True)
|
||||
self.use_vision = unwrap(kwargs.get("vision"), False)
|
||||
|
||||
# Prepare the draft model config if necessary
|
||||
draft_args = unwrap(kwargs.get("draft_model"), {})
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue