tabbyAPI-ollama/backends
kingbri 79f9c6e854 Model: Remove num_experts_per_token
This shouldn't even be an exposed option since changing it always
breaks inference with the model. Let the model's config.json handle
it.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-03-19 11:52:10 -04:00
..
exllamav2 Model: Remove num_experts_per_token 2025-03-19 11:52:10 -04:00
infinity Infinity: Use a runtime type hint for engine 2024-11-22 18:06:08 -05:00