Updated readme

This commit is contained in:
Splice86 2023-11-10 00:39:08 -06:00 committed by GitHub
parent ca992f483f
commit ab84b01fdf
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 47 additions and 9 deletions

View file

@ -81,3 +81,35 @@ curl -X POST "http://localhost:8000/generate-text" -H "Content-Type: application
],
"temperature": 0.7
}'
### Parameter Guide
*note* This stuff still needs to be expanded and updated
{
"prompt": "A tabby is a",
"max_tokens": 200,
"temperature": 1,
"top_p": 0.9,
"seed": 10,
"stream": true,
"token_repetition_penalty": 0.5,
"stop": ["###"]
}
prompt: This is the initial text or message that sets the context for the generated completions.
max_tokens: It defines the maximum number of tokens (words or characters) you want in the generated text.
temperature: The temperature parameter controls the randomness of the output.
top_p: The top_p parameter controls the diversity of the output.
seed: This parameter is set to 10. It is a seed value that helps to reproduce the same results if provided with the same seed.
stream: A boolean value set to true. It enables Server-Sent Events (SSE) streaming.
token_repetition_penalty: This parameter controls the penalty for token repetitions in the generated text.
stop: An array of strings that, if present in the generated text, will signal the model to stop generating.