Model: Set vision load to False by default

Mistake in unwrapping. Vision should be false to allow normal model
loading when the flag isn't provided.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-11-21 17:54:42 -05:00
parent 902045edbb
commit 0ab393f09c

View file

@ -152,7 +152,7 @@ class ExllamaV2Container:
kwargs = await self.set_model_overrides(**kwargs)
# Set vision state
self.use_vision = unwrap(kwargs.get("vision"), True)
self.use_vision = unwrap(kwargs.get("vision"), False)
# Prepare the draft model config if necessary
draft_args = unwrap(kwargs.get("draft_model"), {})