Embeddings: Switch to Infinity
Infinity-emb is an async batching engine for embeddings. This is preferable to sentence-transformers since it handles scalable usecases without the need for external thread intervention. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
parent
c9a5d2c363
commit
3f21d9ef96
4 changed files with 87 additions and 100 deletions
|
|
@ -95,3 +95,8 @@ def logging_config():
|
|||
def developer_config():
|
||||
"""Returns the developer specific config from the global config"""
|
||||
return unwrap(GLOBAL_CONFIG.get("developer"), {})
|
||||
|
||||
|
||||
def embeddings_config():
|
||||
"""Returns the embeddings config from the global config"""
|
||||
return unwrap(GLOBAL_CONFIG.get("embeddings"), {})
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue