jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Model: Remove extraneous print

Browse source 
Was printing IDs by accident.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-04-25 18:49:09 -04:00
parent fb1d2f34c1
commit 5750826120
1 changed files with 0 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
backends/exllamav2/model.py
View file

@ -878,7 +878,6 @@ class ExllamaV2Container:
encode_special_tokens=True,
return_offsets=True,
)
print(ids)
mask = (
self.tokenizer.padding_mask(ids)
if self.use_cfg and gen_settings.cfg_scale not in [None, 1.0]