jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Embeddings: Update config, args, and parameter names

Browse source 
Use embeddings_device as the parameter for device to remove ambiguity.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri 2024-07-30 15:32:26 -04:00
parent bfa011e0ce
commit dc3dcc9c0d
5 changed files with 43 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

2
endpoints/core/types/model.py
View file

@ -139,7 +139,7 @@ class ModelLoadRequest(BaseModel):
class EmbeddingModelLoadRequest(BaseModel):
name: str
device: Optional[str] = None
embeddings_device: Optional[str] = None
class ModelLoadResponse(BaseModel):