openapi: 3.1.0 info: title: vLLM OpenAI-Compatible Server Audio Chat API version: '1' description: 'vLLM is a high-throughput open-source inference and serving engine for LLMs. Running `vllm serve` exposes an OpenAI-compatible REST API plus vLLM-specific endpoints. Authentication is via a server-startup `--api-key` flag; clients supply it as a Bearer token in the Authorization header (matching the OpenAI Python client). ' contact: name: vLLM Documentation url: https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html license: name: Apache-2.0 url: https://www.apache.org/licenses/LICENSE-2.0 servers: - url: http://{host}:{port} description: Local vLLM server variables: host: default: localhost port: default: '8000' security: - bearerAuth: [] tags: - name: Chat description: OpenAI-compatible chat completions paths: /v1/chat/completions: post: tags: - Chat summary: Create a chat completion operationId: createChatCompletion requestBody: required: true content: application/json: schema: $ref: '#/components/schemas/ChatCompletionRequest' responses: '200': description: Chat completion response components: schemas: ChatCompletionRequest: type: object required: - model - messages properties: model: type: string messages: type: array items: type: object properties: role: type: string enum: - system - user - assistant - tool content: type: string stream: type: boolean temperature: type: number max_tokens: type: integer securitySchemes: bearerAuth: type: http scheme: bearer description: API key supplied at server startup via --api-key