ChatCompletionRequest
Represents a request for generating a chat-based completions in an OpenAI-like environment. See Create chat completions.
This data class is used for serialization and defines the parameters required to send a chat completions request, including the input messages, model to use, and various tuning parameters.
Author
Konstantin Pavlov
Constructors
Properties
The penalty value for repetitive token usage in the response.
The maximum number of tokens allowed in the generated completions.
The penalty value for new token usage in the response.
Specifies the level of computational effort to apply during reasoning ("low", "medium", "high").
Defines the response format, including optional JSON schema support.
Options for streaming responses.
A value between 0.0 and 1.0 that controls the randomness of the generated response.
Controls which (if any) function is called by the model.
An alternative to sampling with temperature, called nucleus sampling.