API: Add banned_strings

From exllamav2: List of strings that the generator will refuse to output. As soon as a partial match happens, a checkpoint is saved that the generator can rewind to if need be. Subsequent tokens are then held until the full string is resolved (match or no match) and either emitted or discarded, accordingly.
This commit is contained in:
DocShotgun 2024-05-10 13:53:55 -07:00
parent a1df22668b
commit c0b631ba92
3 changed files with 31 additions and 0 deletions

View file

@ -18,6 +18,10 @@ stop:
override: []
force: false
additive: false
banned_strings:
override: []
force: false
additive: false
token_healing:
override: false
force: false