tabbyAPI-ollama/common
DocShotgun c0b631ba92 API: Add banned_strings
From exllamav2: List of strings that the generator will refuse to output. As soon as a partial match happens, a checkpoint is saved that the generator can rewind to if need be. Subsequent tokens are then held until the full string is resolved (match or no match) and either emitted or discarded, accordingly.
2024-05-10 13:53:55 -07:00
..
args.py Tree: Format 2024-03-13 00:02:55 -04:00
auth.py API: Cleanup permission endpoint 2024-03-18 15:13:26 -04:00
concurrency.py API: Fix blocking iterator execution 2024-03-16 23:23:31 -04:00
config.py Tree: Update to cleanup globals 2024-03-12 23:59:30 -04:00
downloader.py Downloader: Cleanup on exception 2024-04-30 23:26:22 -04:00
gen_logging.py Tree: Format 2024-03-13 23:33:18 -04:00
logger.py API: Add HuggingFace downloader 2024-04-29 01:15:02 -04:00
model.py Common: Migrate request utils to networking 2024-03-21 23:21:57 -04:00
networking.py Network: Fix socket check timeout 2024-04-22 21:33:41 -04:00
sampling.py API: Add banned_strings 2024-05-10 13:53:55 -07:00
signals.py Signal: Fix signal handlers for uvicorn 2024-03-16 23:23:31 -04:00
templating.py Templates: Migrate to class 2024-04-21 23:28:14 -04:00
transformers_utils.py Tree: Add transformers_utils 2024-04-20 00:07:39 -04:00
utils.py Common: Migrate request utils to networking 2024-03-21 23:21:57 -04:00