jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Tree: Remove fasttensors

Browse source 
Now a noop in upstream.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-09-30 00:18:32 -04:00
parent 6726014d35
commit 126a44483c
4 changed files with 0 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

3
config_sample.yml
View file

@ -135,9 +135,6 @@ model:
# WARNING: Don't set this unless you know what you're doing!
num_experts_per_token:
# Enables fasttensors to possibly increase model loading speeds (default: False).
fasttensors: false
# Options for draft models (speculative decoding)
# This will use more VRAM!
draft_model: