Update to README and other minor changes
This commit is contained in:
parent
ab84b01fdf
commit
8e2671a265
10 changed files with 101 additions and 28 deletions
20
README.md
20
README.md
|
|
@ -74,13 +74,19 @@ The tabbyAPI application provides the following endpoint:
|
|||
### Example Request (using `curl`)
|
||||
|
||||
|
||||
curl -X POST "http://localhost:8000/generate-text" -H "Content-Type: application/json" -d '{
|
||||
"model": "your_model_name",
|
||||
"messages": [
|
||||
{"role": "user", "content": "Say this is a test!"}
|
||||
],
|
||||
"temperature": 0.7
|
||||
}'
|
||||
curl http://127.0.0.1:8000/generate-text \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "Your_Model_Path",
|
||||
"prompt": "A tabby is a",
|
||||
"max_tokens": 200,
|
||||
"temperature": 1,
|
||||
"top_p": 0.9,
|
||||
"seed": 10,
|
||||
"stream": true,
|
||||
"token_repetition_penalty": 0.5,
|
||||
"stop": ["###"]
|
||||
}'
|
||||
|
||||
|
||||
### Parameter Guide
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue