API: Add /v1/health endpoint (#178)
* Add healthcheck - localhost only /healthcheck endpoint - cURL healthcheck in docker compose file * Update Healthcheck Response - change endpoint to /health - remove localhost restriction - add docstring * move healthcheck definition to top of the file - make the healthcheck show up first in the openAPI spec * Tree: Format
This commit is contained in:
parent
872eeed581
commit
80198ca056
2 changed files with 12 additions and 0 deletions
|
|
@ -8,6 +8,11 @@ services:
|
||||||
- DO_PULL=true
|
- DO_PULL=true
|
||||||
ports:
|
ports:
|
||||||
- "5000:5000"
|
- "5000:5000"
|
||||||
|
healthcheck:
|
||||||
|
test: ["CMD", "curl", "-f", "http://127.0.0.1:5000/health"]
|
||||||
|
interval: 30s
|
||||||
|
timeout: 10s
|
||||||
|
retries: 3
|
||||||
environment:
|
environment:
|
||||||
- NAME=TabbyAPI
|
- NAME=TabbyAPI
|
||||||
- NVIDIA_VISIBLE_DEVICES=all
|
- NVIDIA_VISIBLE_DEVICES=all
|
||||||
|
|
|
||||||
|
|
@ -44,6 +44,13 @@ from endpoints.core.utils.model import (
|
||||||
router = APIRouter()
|
router = APIRouter()
|
||||||
|
|
||||||
|
|
||||||
|
# Healthcheck endpoint
|
||||||
|
@router.get("/health")
|
||||||
|
async def healthcheck():
|
||||||
|
"""Get the current service health status"""
|
||||||
|
return {"status": "healthy"}
|
||||||
|
|
||||||
|
|
||||||
# Model list endpoint
|
# Model list endpoint
|
||||||
@router.get("/v1/models", dependencies=[Depends(check_api_key)])
|
@router.get("/v1/models", dependencies=[Depends(check_api_key)])
|
||||||
@router.get("/v1/model/list", dependencies=[Depends(check_api_key)])
|
@router.get("/v1/model/list", dependencies=[Depends(check_api_key)])
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue