Dependencies: Pin tokenizers
Use a version greater than 0.20.0 for newer model support. Signed-off-by: kingbri <8082010+bdashore3@users.noreply.github.com>
This commit is contained in:
parent
1ba33bf646
commit
bc3c154c96
1 changed files with 1 additions and 1 deletions
|
|
@ -25,7 +25,7 @@ dependencies = [
|
|||
"loguru",
|
||||
"sse-starlette",
|
||||
"packaging",
|
||||
"tokenizers",
|
||||
"tokenizers>=0.21.0",
|
||||
"formatron",
|
||||
"kbnf>=0.4.1",
|
||||
"aiofiles",
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue