Generate chat completions for a batch of messages using the specified model.
POST/v1/inference/batch-chat-completion
Generate chat completions for a batch of messages using the specified model.
Request​
Responses​
- 200
- 400
- 429
- 500
- default
A BatchChatCompletionResponse with the full completions.
The request was invalid or malformed
The client has sent too many requests in a given amount of time
The server encountered an unexpected error
An unexpected error occurred