tabbyAPI-ollama/backends/exllamav2
randoentity daae9ec43d Exl3: Couldn't wait
Just copied some stuff around and it ended up working for basic use.
2025-05-02 21:33:25 -04:00
..
grammar.py Grammar: Cache the engine vocabulary 2024-12-05 21:36:37 -08:00
model.py Exl3: Couldn't wait 2025-05-02 21:33:25 -04:00
utils.py Dependencies: Update torch, exllamav2, and flash-attn 2025-02-09 01:27:48 -05:00
version.py Dependencies: Update torch, exllamav2, and flash-attn 2025-02-09 01:27:48 -05:00
vision.py Dependencies: Fix OpenAPI generation 2024-11-22 17:59:20 -05:00