tabbyAPI-ollama/backends
kingbri 0dcbb7a722 Dependencies: Update torch, exllamav2, and flash-attn
Torch - 2.6.0
ExllamaV2 - 0.2.8
Flash-attn - 2.7.4.post1

Cuda wheels are now 12.4 instead of 12.1, feature names need to be
migrated over.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-02-09 01:27:48 -05:00
..
exllamav2 Dependencies: Update torch, exllamav2, and flash-attn 2025-02-09 01:27:48 -05:00
infinity Infinity: Use a runtime type hint for engine 2024-11-22 18:06:08 -05:00