Generate with Messages

POST /v1/messages

Anthropic Messages-compatible generation. Supply model, messages and max_tokens. This endpoint accepts x-api-key as an alternative to Bearer authentication and forwards anthropic-version and anthropic-beta when present. Read text blocks inside content[]; this shape differs from both Responses and Chat Completions, and errors use the Anthropic error envelope. Streaming uses content_block_delta and message_stop. Each endpoint requires a model whose supported_endpoints includes that exact path. These APIs forward the selected model's protocol, so optional parameters and response details can vary by local worker or remote provider. Local models keep inputs on the device; a configured remote model receives the request sent to it.

Guide and examplesLanguage and vision·All endpoints

Parameters

Request body

application/jsonRequired

Responses

{
  "id": "msg_example",
  "type": "message",
  "role": "assistant",
  "model": "Qwen/Qwen3.5-4B",
  "content": [
    {
      "type": "text",
      "text": "Hello!"
    }
  ],
  "stop_reason": "end_turn",
  "usage": {
    "input_tokens": 16,
    "output_tokens": 3
  }
}