tabbyAPI-ollama/backends
DocShotgun f8070e7707 Model: Auto detect model backend from config
* Use exllamav3 for exl3 models, exllamav2 otherwise
2025-05-06 18:51:58 -07:00
..
exllamav2 Model: Fetch from generation_config and tokenizer_config in Exl3 2025-05-02 21:33:25 -04:00
exllamav3 Model: Auto detect model backend from config 2025-05-06 18:51:58 -07:00
infinity Model: Add proper jobs cleanup and fix var calls 2025-04-24 21:30:55 -04:00
base_model_container.py Model: Add exl3 and associated load functions 2025-05-02 21:32:39 -04:00