Update to README and other minor changes

This commit is contained in:
Splice86 2023-11-10 01:37:24 -06:00
parent ab84b01fdf
commit 8e2671a265
10 changed files with 101 additions and 28 deletions

View file

@ -74,13 +74,19 @@ The tabbyAPI application provides the following endpoint:
### Example Request (using `curl`)
curl -X POST "http://localhost:8000/generate-text" -H "Content-Type: application/json" -d '{
"model": "your_model_name",
"messages": [
{"role": "user", "content": "Say this is a test!"}
],
"temperature": 0.7
}'
curl http://127.0.0.1:8000/generate-text \
-H "Content-Type: application/json" \
-d '{
"model": "Your_Model_Path",
"prompt": "A tabby is a",
"max_tokens": 200,
"temperature": 1,
"top_p": 0.9,
"seed": 10,
"stream": true,
"token_repetition_penalty": 0.5,
"stop": ["###"]
}'
### Parameter Guide