openapi: 3.0.1 info: contact: email: support@aiven.io name: Aiven support team url: https://aiven.io/support-services title: Aiven API Documentation Account Service:_Kafka API version: v1 x-logo: altText: Aiven logo backgroundColor: '#fafafa' href: https://api.aiven.io/doc url: https://aiven.io/assets/img/aiven-logo.png description: "# Introduction\n\n[Direct link to openapi.json](https://api.aiven.io/doc/openapi.json) for use with external tools\n\n[Aiven](https://aiven.io) is a modern fully-managed open source data platform for streaming, storing, and analyzing data on any public cloud. On Aiven Platform, you can operate your data infrastructure with a few devops tools: [Aiven Console](https://console.aiven.io/), [Aiven Terraform Provider](https://aiven.io/docs/tools/terraform), [Aiven CLI](https://github.com/aiven/aiven-client), and [Aiven Operator for Kubernetes](https://github.com/aiven/aiven-operator). All of them are built on an open secure powerful REST API for integration with custom tooling.\n\nThe Aiven [REST](http://en.wikipedia.org/wiki/Representational_State_Transfer) API\nprovides programmatic access to Aiven.io services. To call the Aiven API, you can use either CLI tools (for example, `cURL` or [Aiven CLI client](https://aiven.io/docs/tools/cli)) or GUI tools, such as the [Aiven public API Postman collection](https://www.postman.com/aiven-apis).\n\nThis Aiven API documentation will help you operate your Aiven organization, projects, or services programmatically by integrating your applications and processes with Aiven.\n\n# Description\n\nAiven's APIs ([Application Programming Interfaces](https://en.wikipedia.org/wiki/API)) power its platform for data management. Aiven has a number of REST APIs that can help you build strong and robust data infrastructure for your applications.\n\nThe Aiven API is organized around core resources. Each core resource has multiple endpoints, which can be interacted with using different HTTP methods.\n\n## Core resources\n\n### Platform APIs\n\n
Returns successfully resolved connectors in 'connectors' array. If any connectors fail plugin resolution, they are returned in 'failed_connectors' array with an 'error' field explaining the issue.
parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectListResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/connectors/{connector_name}: delete: summary: Delete Kafka Connect connector tags: - Service:_Kafka operationId: ServiceKafkaConnectDeleteConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectDeleteConnectorResponse' security: - tokenAuth: [] oauth2: - services:write put: summary: Edit Kafka Connect connector tags: - Service:_Kafka operationId: ServiceKafkaConnectEditConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectEditConnectorRequestBody' example: connector\.class: io.debezium.connector.postgresql.PostgresConnector name: s3-sink-us-east-1 responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectEditConnectorResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/available-connectors: get: summary: Get available Kafka Connect connectors tags: - Service:_Kafka operationId: ServiceKafkaConnectGetAvailableConnectors parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectGetAvailableConnectorsResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/connector-plugins/{connector_name}/configuration: get: summary: Get Kafka Connect connector configuration schema tags: - Service:_Kafka operationId: ServiceKafkaConnectGetConnectorConfiguration parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectGetConnectorConfigurationResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/connectors/{connector_name}/status: get: summary: Get a Kafka Connect Connector status tags: - Service:_Kafka operationId: ServiceKafkaConnectGetConnectorStatus parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectGetConnectorStatusResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/connectors/{connector_name}/pause: post: summary: Pause a Kafka Connect Connector tags: - Service:_Kafka operationId: ServiceKafkaConnectPauseConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectPauseConnectorResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/connectors/{connector_name}/restart: post: summary: Restart a Kafka Connect Connector tags: - Service:_Kafka operationId: ServiceKafkaConnectRestartConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectRestartConnectorResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/connectors/{connector_name}/tasks/{task_id}/restart: post: summary: Restart a Kafka Connect Connector task tags: - Service:_Kafka operationId: ServiceKafkaConnectRestartConnectorTask parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' - $ref: '#/components/parameters/task_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectRestartConnectorTaskResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/connectors/{connector_name}/resume: post: summary: Resume a Kafka Connect Connector tags: - Service:_Kafka operationId: ServiceKafkaConnectResumeConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectResumeConnectorResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/connectors/{connector_name}/stop: post: summary: Stop a Kafka Connect Connector tags: - Service:_Kafka operationId: ServiceKafkaConnectStopConnector parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/connector_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaConnectStopConnectorResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/acl: post: summary: Add a Kafka-native ACL entry tags: - Service:_Kafka operationId: ServiceKafkaNativeAclAdd parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaNativeAclAddRequestBody' example: host: '*' operation: Read pattern_type: LITERAL permission_type: ALLOW principal: User:alice resource_name: consumer-group-1. resource_type: Topic responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaNativeAclAddResponse' '400': description: Invalid request parameters content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_acl_too_many title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_acl_too_many: Maximum number of service ACLs reached' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_acl_not_supported title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_acl_not_supported: Unsupported Kafka-native ACL' security: - tokenAuth: [] oauth2: - services:write get: summary: List Kafka-native ACL entries tags: - Service:_Kafka operationId: ServiceKafkaNativeAclList parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaNativeAclListResponse' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_not_found: Service not found' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_maintenance_required title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_maintenance_required: The service does not support the functionality. A maintenance update is required.' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/acl/{kafka_acl_id}: delete: summary: Delete a Kafka-native ACL entry tags: - Service:_Kafka operationId: ServiceKafkaNativeAclDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/kafka_acl_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaNativeAclDeleteResponse' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_acl_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_acl_not_found: No such service ACL exists' security: - tokenAuth: [] oauth2: - services:write get: summary: Get single Kafka-native ACL entry tags: - Service:_Kafka operationId: ServiceKafkaNativeAclGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/kafka_acl_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaNativeAclGetResponse' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_acl_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_acl_not_found: No such service ACL exists' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/quota: post: summary: Create Kafka quota tags: - Service:_Kafka operationId: ServiceKafkaQuotaCreate parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaQuotaCreateRequestBody' example: client\-id: abc123 consumer_byte_rate: '1048576' producer_byte_rate: '1048576' request_percentage: '25' user: alice responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaQuotaCreateResponse' security: - tokenAuth: [] oauth2: - services:write delete: summary: Delete Kafka quota tags: - Service:_Kafka operationId: ServiceKafkaQuotaDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/servicekafkaquotadelete_client-id' - $ref: '#/components/parameters/servicekafkaquotadelete_user' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaQuotaDeleteResponse' security: - tokenAuth: [] oauth2: - services:write get: summary: List Kafka quotas tags: - Service:_Kafka operationId: ServiceKafkaQuotaList parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaQuotaListResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/quota/describe: get: summary: Describe Specific Kafka quotas tags: - Service:_Kafka operationId: ServiceKafkaQuotaDescribe parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/servicekafkaquotadescribe_client-id' - $ref: '#/components/parameters/servicekafkaquotadescribe_user' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaQuotaDescribeResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/tiered-storage/storage-usage/by-topic: get: summary: Get the Kafka tiered storage object storage usage by topic tags: - Service:_Kafka operationId: ServiceKafkaTieredStorageStorageUsageByTopic description:Return "400 Bad Request" if tiered storage feature is not enabled for this service. Rarely, the data may be not available. In this case, "503 Service Unavailable" is returned and the client should try later.
parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTieredStorageStorageUsageByTopicResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/tiered-storage/storage-usage/total: get: summary: Get the Kafka tiered storage total object storage usage tags: - Service:_Kafka operationId: ServiceKafkaTieredStorageStorageUsageTotal description:Return "400 Bad Request" if tiered storage feature is not enabled for this service. Rarely, the data may be not available. In this case, "503 Service Unavailable" is returned and the client should try later.
parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTieredStorageStorageUsageTotalResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/tiered-storage/summary: get: summary: Get the Kafka tiered storage summary tags: - Service:_Kafka operationId: ServiceKafkaTieredStorageSummary parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTieredStorageSummaryResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/topic: post: summary: Create a Kafka topic tags: - Service:_Kafka operationId: ServiceKafkaTopicCreate parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicCreateRequestBody' example: cleanup_policy: delete config: cleanup_policy: delete compression_type: zstd delete_retention_ms: 0 diskless_enable: false file_delete_delay_ms: 0 flush_messages: 0 flush_ms: 0 index_interval_bytes: 0 local_retention_bytes: -2 local_retention_ms: -2 max_compaction_lag_ms: 0 max_message_bytes: 0 message_downconversion_enable: true message_format_version: 2.7-IV2 message_timestamp_after_max_ms: 0 message_timestamp_before_max_ms: 0 message_timestamp_difference_max_ms: 0 message_timestamp_type: CreateTime min_cleanable_dirty_ratio: 0.5 min_compaction_lag_ms: 0 min_insync_replicas: 2 preallocate: false remote_storage_enable: false retention_bytes: -1 retention_ms: 604800000 segment_bytes: 1073741824 segment_index_bytes: 0 segment_jitter_ms: 0 segment_ms: 1 unclean_leader_election_enable: false min_insync_replicas: 2 owner_user_group_id: ug22ba494e096 partitions: 1 replication: 2 retention_bytes: -1 retention_hours: 72 tags: - key: My-tag_key value: My tag value, value. topic_description: Platform events topic_name: mytopic responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicCreateResponse' '400': description: Invalid request parameters content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_invalid_config title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_invalid_config: Topic configuration either invalid or conflicting with kafka setup' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_already_exists title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_already_exists: Topic already exists and cannot be created' '503': description: The server cannot process the request due to a high load content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_service_unavailable title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_service_unavailable: Kafka service is currently unavailable' security: - tokenAuth: [] oauth2: - services:write get: summary: Get Kafka topic list tags: - Service:_Kafka operationId: ServiceKafkaTopicList parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicListResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/topic/{topic_name}: delete: summary: Delete a Kafka topic tags: - Service:_Kafka operationId: ServiceKafkaTopicDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/topic_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicDeleteResponse' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_not_found: No such topic exists' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_reserved title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_reserved: Topic is reserved for internal use' '503': description: The server cannot process the request due to a high load content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_service_unavailable title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_service_unavailable: Kafka service is currently unavailable' security: - tokenAuth: [] oauth2: - services:write get: summary: Get Kafka topic info tags: - Service:_Kafka operationId: ServiceKafkaTopicGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/topic_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicGetResponse' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_not_found: No such topic exists' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_not_synchronized title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_not_synchronized: Topic state is not synchronized' security: - tokenAuth: [] oauth2: - services:read put: summary: Update a Kafka topic tags: - Service:_Kafka operationId: ServiceKafkaTopicUpdate parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/topic_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicUpdateRequestBody' example: config: cleanup_policy: delete compression_type: zstd delete_retention_ms: 0 diskless_enable: false file_delete_delay_ms: 0 flush_messages: 0 flush_ms: 0 index_interval_bytes: 0 local_retention_bytes: -2 local_retention_ms: -2 max_compaction_lag_ms: 0 max_message_bytes: 0 message_downconversion_enable: true message_format_version: 2.7-IV2 message_timestamp_after_max_ms: 0 message_timestamp_before_max_ms: 0 message_timestamp_difference_max_ms: 0 message_timestamp_type: CreateTime min_cleanable_dirty_ratio: 0.5 min_compaction_lag_ms: 0 min_insync_replicas: 2 preallocate: false remote_storage_enable: false retention_bytes: -1 retention_ms: 604800000 segment_bytes: 1073741824 segment_index_bytes: 0 segment_jitter_ms: 0 segment_ms: 1 unclean_leader_election_enable: false min_insync_replicas: 2 owner_user_group_id: ug22ba494e096 partitions: 1 replication: 2 retention_bytes: -1 retention_hours: 72 tags: - key: My-tag_key value: My tag value, value. topic_description: Platform events responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicUpdateResponse' '400': description: Invalid request parameters content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_invalid_config title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_invalid_config: Topic configuration either invalid or conflicting with kafka setup' '404': description: Resource not found content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_topic_not_found title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_topic_not_found: No such topic exists' '409': description: Request conflict content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_partition_reassignment_in_progress title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_partition_reassignment_in_progress: Unable to update partitions during partition reassignment' '503': description: The server cannot process the request due to a high load content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - kafka_service_unavailable title: Machine processable error code. Clients must be prepared to handle new codes. description: 'kafka_service_unavailable: Kafka service is currently unavailable' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/rest/topics/{topic_name}/messages: post: summary: List kafka topic messages tags: - Service:_Kafka operationId: ServiceKafkaTopicMessageList parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/topic_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicMessageListRequestBody' example: format: json max_bytes: 67108864 partitions: {} timeout: 3000 responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicMessageListResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/rest/topics/{topic_name}/produce: post: summary: Produce message into a kafka topic tags: - Service:_Kafka operationId: ServiceKafkaTopicMessageProduce parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/topic_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicMessageProduceRequestBody' example: format: binary key_schema: '{\"name\": \"int\", \"type\": \"int\"}' key_schema_id: 123 records: - key: {} partition: 1 value: {} value_schema: '{\"name\": \"int\", \"type\": \"int\"}' value_schema_id: 123 responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceKafkaTopicMessageProduceResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/schema-registry/acl: post: summary: Add a Schema Registry ACL entry tags: - Service:_Kafka operationId: ServiceSchemaRegistryAclAdd parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryAclAddRequestBody' example: permission: schema_registry_read resource: 'Config:' username: admin* responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryAclAddResponse' '400': description: Invalid request parameters content: application/json: schema: type: object properties: message: type: string title: Human readable error message errors: type: array title: List of error details. Typically there is only one element items: type: object properties: message: type: string title: Human readable error message error_code: type: string enum: - service_acl_too_many title: Machine processable error code. Clients must be prepared to handle new codes. description: 'service_acl_too_many: Maximum number of service ACLs reached' security: - tokenAuth: [] oauth2: - services:write get: summary: List Schema Registry ACL entries tags: - Service:_Kafka operationId: ServiceSchemaRegistryAclList parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryAclListResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema-registry/acl/{schema_registry_acl_id}: delete: summary: Delete a Schema Registry ACL entry tags: - Service:_Kafka operationId: ServiceSchemaRegistryAclDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/schema_registry_acl_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryAclDeleteResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/schema/compatibility/subjects/{subject_name}/versions/{version_id}: post: summary: Check compatibility of schema in Schema Registry tags: - Service:_Kafka operationId: ServiceSchemaRegistryCompatibility parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' - $ref: '#/components/parameters/version_id' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryCompatibilityRequestBody' example: schema: '{"type": "string"}' schemaType: AVRO responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryCompatibilityResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema/config: get: summary: Get global configuration for Schema Registry tags: - Service:_Kafka operationId: ServiceSchemaRegistryGlobalConfigGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryGlobalConfigGetResponse' security: - tokenAuth: [] oauth2: - services:read put: summary: Edit global configuration for Schema Registry tags: - Service:_Kafka operationId: ServiceSchemaRegistryGlobalConfigPut parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryGlobalConfigPutRequestBody' example: compatibility: FULL responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistryGlobalConfigPutResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/schema/schemas/ids/{schema_id}: get: summary: Get schema in Schema Registry tags: - Service:_Kafka operationId: ServiceSchemaRegistrySchemaGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/schema_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySchemaGetResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema/config/{subject_name}: get: summary: Get configuration for Schema Registry subject tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectConfigGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectConfigGetResponse' security: - tokenAuth: [] oauth2: - services:read put: summary: Edit configuration for Schema Registry subject tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectConfigPut parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectConfigPutRequestBody' example: compatibility: FULL responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectConfigPutResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/schema/subjects/{subject_name}: delete: summary: Delete Schema Registry subject tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectDeleteResponse' security: - tokenAuth: [] oauth2: - services:write /project/{project}/service/{service_name}/kafka/schema/subjects/{subject_name}/versions/{version_id}: delete: summary: Delete Schema Registry subject version tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectVersionDelete parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' - $ref: '#/components/parameters/version_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionDeleteResponse' security: - tokenAuth: [] oauth2: - services:write get: summary: Get Schema Registry Subject version tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectVersionGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' - $ref: '#/components/parameters/version_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionGetResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema/subjects/{subject_name}/versions: post: summary: Register a new Schema in Schema Registry tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectVersionPost parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' requestBody: content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionPostRequestBody' example: references: - name: container1.proto subject: topic1-values version: 1 schema: '{"type": "string"}' schemaType: AVRO responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionPostResponse' security: - tokenAuth: [] oauth2: - services:write get: summary: Get Schema Registry subject versions tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectVersionsGet parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionsGetResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema/subjects/{subject_name}/versions/{version_id}/schema: get: summary: 'DEPRECATED: Get raw schema of a specific version in Schema Registry' tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjectVersionSchemaGet deprecated: true parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' - $ref: '#/components/parameters/subject_name' - $ref: '#/components/parameters/version_id' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectVersionSchemaGetResponse' security: - tokenAuth: [] oauth2: - services:read /project/{project}/service/{service_name}/kafka/schema/subjects: get: summary: Lists Schema Registry subjects tags: - Service:_Kafka operationId: ServiceSchemaRegistrySubjects parameters: - $ref: '#/components/parameters/project' - $ref: '#/components/parameters/service_name' responses: '200': description: Response content: application/json: schema: $ref: '#/components/schemas/ServiceSchemaRegistrySubjectsResponse' security: - tokenAuth: [] oauth2: - services:read components: schemas: ServiceSchemaRegistryCompatibilityResponse: type: object description: ServiceSchemaRegistryCompatibilityResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status is_compatible: type: boolean description: Compatibility message: type: string description: Printable result of the request messages: type: array maxItems: 128 description: Compatibility check messages items: type: string required: - is_compatible ServiceSchemaRegistryAclDeleteResponse: type: object description: ServiceSchemaRegistryAclDeleteResponse properties: acl: type: array description: List of Schema Registry ACL entries items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: ACL entry for Schema Registry enum: - schema_registry_read - schema_registry_write resource: type: string minLength: 1 maxLength: 249 description: Schema Registry ACL entry resource name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - resource - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceSchemaRegistrySubjectDeleteResponse: type: object description: ServiceSchemaRegistrySubjectDeleteResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaTopicUpdateResponse: type: object description: ServiceKafkaTopicUpdateResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistrySubjectVersionDeleteResponse: type: object description: ServiceSchemaRegistrySubjectVersionDeleteResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaQuotaCreateRequestBody: type: object description: ServiceKafkaQuotaCreateRequestBody properties: client\-id: type: string maxLength: 255 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: client-id consumer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: consumer network throttle producer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: producer network throttle request_percentage: type: number minimum: 0 maximum: 100 description: Sets the maximum percentage of CPU time that a client group can use on request handler I/O and network threads per broker within a quota window. Exceeding this limit triggers throttling. The quota, expressed as a percentage, also indicates the total allowable CPU usage for the client groups sharing the quota. title: cpu percentage throttle user: type: string maxLength: 64 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: user ServiceKafkaTopicUpdateRequestBody: type: object description: ServiceKafkaTopicUpdateRequestBody properties: config: type: object description: Kafka topic configuration properties: cleanup_policy: type: string description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: cleanup.policy enum: - delete - compact - compact,delete compression_type: type: string description: Specify the final compression type for a given topic. This configuration accepts the standard compression codecs ('gzip', 'snappy', 'lz4', 'zstd'). It additionally accepts 'uncompressed' which is equivalent to no compression; and 'producer' which means retain the original compression codec set by the producer. title: compression.type enum: - snappy - gzip - lz4 - producer - uncompressed - zstd delete_retention_ms: type: integer minimum: 0 description: The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage (otherwise delete tombstones may be collected before they complete their scan). title: delete.retention.ms diskless_enable: type: boolean description: Indicates whether diskless should be enabled. This is only available for BYOC services with Diskless feature enabled. title: diskless.enable file_delete_delay_ms: type: integer minimum: 0 description: The time to wait before deleting a file from the filesystem. title: file.delete.delay.ms flush_messages: type: integer minimum: 0 description: This setting allows specifying an interval at which we will force an fsync of data written to the log. For example if this was set to 1 we would fsync after every message; if it were 5 we would fsync after every five messages. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.messages flush_ms: type: integer minimum: 0 description: This setting allows specifying a time interval at which we will force an fsync of data written to the log. For example if this was set to 1000 we would fsync after 1000 ms had passed. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.ms index_interval_bytes: type: integer minimum: 0 description: This setting controls how frequently Kafka adds an index entry to its offset index. The default setting ensures that we index a message roughly every 4096 bytes. More indexing allows reads to jump closer to the exact position in the log but makes the index larger. You probably don't need to change this. title: index.interval.bytes local_retention_bytes: type: integer description: This configuration controls the maximum bytes tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the limit is equal to overall retention time. If set to -1, no limit is applied but it's possible only if overall retention is also -1. title: local.retention.bytes local_retention_ms: type: integer description: This configuration controls the maximum time tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the time limit is equal to overall retention time. If set to -1, no time limit is applied but it's possible only if overall retention is also -1. title: local.retention.ms max_compaction_lag_ms: type: integer minimum: 0 description: The maximum time a message will remain ineligible for compaction in the log. Only applicable for logs that are being compacted. title: max.compaction.lag.ms max_message_bytes: type: integer minimum: 0 description: The largest record batch size allowed by Kafka (after compression if compression is enabled). If this is increased and there are consumers older than 0.10.2, the consumers' fetch size must also be increased so that the they can fetch record batches this large. In the latest message format version, records are always grouped into batches for efficiency. In previous message format versions, uncompressed records are not grouped into batches and this limit only applies to a single record in that case. title: max.message.bytes message_downconversion_enable: type: boolean description: This configuration controls whether down-conversion of message formats is enabled to satisfy consume requests. When set to false, broker will not perform down-conversion for consumers expecting an older message format. The broker responds with UNSUPPORTED_VERSION error for consume requests from such older clients. This configuration does not apply to any message format conversion that might be required for replication to followers. title: message.downconversion.enable message_format_version: type: string description: 'Specify the message format version the broker will use to append messages to the logs. The value should be a valid ApiVersion. Some examples are: 0.8.2, 0.9.0.0, 0.10.0, check ApiVersion for more details. By setting a particular message format version, the user is certifying that all the existing messages on disk are smaller or equal than the specified version. Setting this value incorrectly will cause consumers with older versions to break as they will receive messages with a format that they don''t understand. Deprecated in Kafka 4.0+: this configuration is removed and any supplied value will be ignored; for services upgraded to 4.0+, the returned value may be ''None''.' title: message.format.version enum: - 0.8.0 - 0.8.1 - 0.8.2 - 0.9.0 - 0.10.0 - 0.10.0-IV0 - 0.10.0-IV1 - 0.10.1 - 0.10.1-IV0 - 0.10.1-IV1 - 0.10.1-IV2 - 0.10.2 - 0.10.2-IV0 - 0.11.0 - 0.11.0-IV0 - 0.11.0-IV1 - 0.11.0-IV2 - '1.0' - 1.0-IV0 - '1.1' - 1.1-IV0 - '2.0' - 2.0-IV0 - 2.0-IV1 - '2.1' - 2.1-IV0 - 2.1-IV1 - 2.1-IV2 - '2.2' - 2.2-IV0 - 2.2-IV1 - '2.3' - 2.3-IV0 - 2.3-IV1 - '2.4' - 2.4-IV0 - 2.4-IV1 - '2.5' - 2.5-IV0 - '2.6' - 2.6-IV0 - '2.7' - 2.7-IV0 - 2.7-IV1 - 2.7-IV2 - '2.8' - 2.8-IV0 - 2.8-IV1 - '3.0' - 3.0-IV0 - 3.0-IV1 - '3.1' - 3.1-IV0 - '3.2' - 3.2-IV0 - '3.3' - 3.3-IV0 - 3.3-IV1 - 3.3-IV2 - 3.3-IV3 - '3.4' - 3.4-IV0 - '3.5' - 3.5-IV0 - 3.5-IV1 - 3.5-IV2 - '3.6' - 3.6-IV0 - 3.6-IV1 - 3.6-IV2 - '3.7' - 3.7-IV0 - 3.7-IV1 - 3.7-IV2 - 3.7-IV3 - 3.7-IV4 - '3.8' - 3.8-IV0 - '3.9' - 3.9-IV0 - 3.9-IV1 - '4.0' - 4.0-IV0 - '4.1' - 4.1-IV0 - '4.2' - 4.2-IV0 message_timestamp_after_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps later than the broker's timestamp. title: message.timestamp.after.max.ms message_timestamp_before_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps earlier than the broker's timestamp. title: message.timestamp.before.max.ms message_timestamp_difference_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. This configuration is ignored if message.timestamp.type=LogAppendTime. title: message.timestamp.difference.max.ms message_timestamp_type: type: string description: Define whether the timestamp in the message is message create time or log append time. title: message.timestamp.type enum: - CreateTime - LogAppendTime min_cleanable_dirty_ratio: type: number minimum: 0 maximum: 1 description: 'This configuration controls how frequently the log compactor will attempt to clean the log (assuming log compaction is enabled). By default we will avoid cleaning a log where more than 50% of the log has been compacted. This ratio bounds the maximum space wasted in the log by duplicates (at 50% at most 50% of the log could be duplicates). A higher ratio will mean fewer, more efficient cleanings but will mean more wasted space in the log. If the max.compaction.lag.ms or the min.compaction.lag.ms configurations are also specified, then the log compactor considers the log to be eligible for compaction as soon as either: (i) the dirty ratio threshold has been met and the log has had dirty (uncompacted) records for at least the min.compaction.lag.ms duration, or (ii) if the log has had dirty (uncompacted) records for at most the max.compaction.lag.ms period.' title: min.cleanable.dirty.ratio min_compaction_lag_ms: type: integer minimum: 0 description: The minimum time a message will remain uncompacted in the log. Only applicable for logs that are being compacted. title: min.compaction.lag.ms min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: min.insync.replicas preallocate: type: boolean description: True if we should preallocate the file on disk when creating a new log segment. title: preallocate remote_storage_enable: type: boolean description: Indicates whether tiered storage should be enabled. This is only available for services with Tiered Storage feature enabled. title: remote.storage.enable retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: retention.bytes retention_ms: type: integer description: This configuration controls the maximum time we will retain a log before we will discard old log segments to free up space if we are using the 'delete' retention policy. This represents an SLA on how soon consumers must read their data. If set to -1, no time limit is applied. title: retention.ms segment_bytes: type: integer minimum: 14 description: This configuration controls the segment file size for the log. Retention and cleaning is always done a file at a time so a larger segment size means fewer files but less granular control over retention. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 megabytes. title: segment.bytes segment_index_bytes: type: integer minimum: 0 description: This configuration controls the size of the index that maps offsets to file positions. We preallocate this index file and shrink it only after log rolls. You generally should not need to change this setting. title: segment.index.bytes segment_jitter_ms: type: integer minimum: 0 description: The maximum random jitter subtracted from the scheduled segment roll time to avoid thundering herds of segment rolling title: segment.jitter.ms segment_ms: type: integer minimum: 1 description: This configuration controls the period of time after which Kafka will force the log to roll even if the segment file isn't full to ensure that retention can delete or compact old data. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 seconds. title: segment.ms unclean_leader_election_enable: type: boolean description: Indicates whether to enable replicas not in the ISR set to be elected as leader as a last resort, even though doing so may result in data loss. title: unclean.leader.election.enable min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: 'DEPRECATED: use config.min_insync_replicas' owner_user_group_id: type: string minLength: 1 maxLength: 36 description: The user group that owns this topic partitions: type: integer minimum: 1 maximum: 1000000 description: Number of partitions replication: type: integer minimum: 1 description: Number of replicas retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: 'DEPRECATED: use config.retention_bytes' retention_hours: type: integer maximum: 2562047788015 description: 'DEPRECATED: use config.retention_ms' tags: type: array minItems: 0 maxItems: 25 description: Topic tags items: type: object properties: key: type: string minLength: 1 maxLength: 64 description: Tag key value: type: string minLength: 0 maxLength: 256 description: Tag value required: - key - value topic_description: type: string minLength: 1 maxLength: 256 description: Topic description ServiceKafkaAclDeleteResponse: type: object description: ServiceKafkaAclDeleteResponse properties: acl: type: array description: List of Aiven ACL entries for Kafka service items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: Kafka permission enum: - admin - read - readwrite - write topic: type: string minLength: 1 maxLength: 249 description: Topic name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - topic - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceKafkaConnectPauseConnectorResponse: type: object description: ServiceKafkaConnectPauseConnectorResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaNativeAclListResponse: type: object description: ServiceKafkaNativeAclListResponse properties: acl: type: array description: List of Aiven ACL entries for Kafka service items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: Kafka permission enum: - admin - read - readwrite - write topic: type: string minLength: 1 maxLength: 249 description: Topic name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - topic - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status kafka_acl: type: array description: List of Kafka-native ACL entries items: type: object properties: host: type: string minLength: 0 maxLength: 256 description: the host or * for all hosts id: type: string maxLength: 40 description: ID operation: type: string description: Kafka ACL operation represents an operation which an ACL grants or denies permission to perform enum: - All - Alter - AlterConfigs - ClusterAction - Create - CreateTokens - Delete - Describe - DescribeConfigs - DescribeTokens - IdempotentWrite - Read - Write pattern_type: type: string description: Kafka ACL pattern type of resource name enum: - LITERAL - PREFIXED permission_type: type: string description: Kafka ACL permission type enum: - ALLOW - DENY principal: type: string minLength: 0 maxLength: 256 description: principal is in 'principalType:name' format resource_name: type: string minLength: 0 maxLength: 256 description: Resource pattern used to match specified resources resource_type: type: string description: Kafka ACL resource type represents a type of resource which an ACL can be applied to enum: - Cluster - DelegationToken - Group - Topic - TransactionalId - User required: - host - id - operation - pattern_type - permission_type - principal - resource_name - resource_type message: type: string description: Printable result of the request required: - acl - kafka_acl ServiceKafkaAclAddResponse: type: object description: ServiceKafkaAclAddResponse properties: acl: type: array description: List of Aiven ACL entries for Kafka service items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: Kafka permission enum: - admin - read - readwrite - write topic: type: string minLength: 1 maxLength: 249 description: Topic name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - topic - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceSchemaRegistrySubjectVersionGetResponse: type: object description: ServiceSchemaRegistrySubjectVersionGetResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request version: type: object description: Version properties: id: type: integer minimum: 0 description: Schema Id references: type: array maxItems: 128 description: Schema references items: type: object properties: name: type: string maxLength: 1024 description: The name used to reference the provided subject and version title: Name subject: type: string maxLength: 1024 description: Subject version: type: integer minimum: 0 description: Version required: - name - subject - version schema: type: string maxLength: 1048576 description: Schema schemaType: type: string description: Schema type enum: - AVRO - JSON - PROTOBUF subject: type: string maxLength: 1024 description: Subject version: type: integer minimum: 0 description: Version required: - id - schema - subject - version required: - version ServiceKafkaTopicMessageListResponse: type: object description: ServiceKafkaTopicMessageListResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request messages: type: array description: List of messages from topic items: type: object properties: key: type: object description: The message key, formatted according to the embedded format properties: {} offset: type: integer description: Offset of the message partition: type: integer description: Partition of the message topic: type: string description: The name of the topic value: type: object description: The message value, formatted according to the embedded format properties: {} ServiceKafkaNativeAclGetResponse: type: object description: ServiceKafkaNativeAclGetResponse properties: acl: type: object description: Kafka-native ACL entry for Kafka service properties: host: type: string minLength: 0 maxLength: 256 description: the host or * for all hosts id: type: string maxLength: 40 description: ID operation: type: string description: Kafka ACL operation represents an operation which an ACL grants or denies permission to perform enum: - All - Alter - AlterConfigs - ClusterAction - Create - CreateTokens - Delete - Describe - DescribeConfigs - DescribeTokens - IdempotentWrite - Read - Write pattern_type: type: string description: Kafka ACL pattern type of resource name enum: - LITERAL - PREFIXED permission_type: type: string description: Kafka ACL permission type enum: - ALLOW - DENY principal: type: string minLength: 0 maxLength: 256 description: principal is in 'principalType:name' format resource_name: type: string minLength: 0 maxLength: 256 description: Resource pattern used to match specified resources resource_type: type: string description: Kafka ACL resource type represents a type of resource which an ACL can be applied to enum: - Cluster - DelegationToken - Group - Topic - TransactionalId - User required: - host - id - operation - pattern_type - permission_type - principal - resource_name - resource_type errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceKafkaConnectEditConnectorResponse: type: object description: ServiceKafkaConnectEditConnectorResponse properties: connector: type: object description: Kafka connector information properties: config: type: object description: Connector configuration parameters properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name name: type: string maxLength: 1024 description: Connector name plugin: type: object description: Kafka Connector plugin information properties: author: type: string description: Connector author name available_versions: type: array description: Versions available on the service items: type: object properties: deprecated: type: boolean description: If the version is deprecated. needs_maintenance: type: boolean description: Using this version requires a maintenance update. version: type: string description: Connector version number class: type: string description: Connector class name docURL: type: string description: Connector documentation URL plugin_name: type: string description: Connector plugin name preview: type: boolean description: Describes if connector is in beta preview_info: type: string description: Information about beta stage of connector title: type: string description: Descriptive human readable name defined by Aiven type: type: string description: Describes whether data flows from or to Kafka enum: - sink - source - unknown version: type: string description: Connector version number required: - author - class - docURL - title - type - version tasks: type: array description: List of tasks of a connector items: type: object properties: connector: type: string description: Related connector name task: type: integer description: Task id / number required: - connector - task required: - config - name - plugin - tasks errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - connector ServiceKafkaConnectGetConnectorConfigurationResponse: type: object description: ServiceKafkaConnectGetConnectorConfigurationResponse properties: configuration_schema: type: array description: List of connector configuration field definitions items: type: object properties: default_value: type: string description: Default value to be set if field omitted in configuration display_name: type: string description: Human friendly name of the field documentation: type: string description: Assisting help text group: type: string description: Name of the field group to which the field belongs to importance: type: string description: How important is the field enum: - LOW - MEDIUM - HIGH name: type: string description: Machine friendly name of the field order: type: integer description: Position of the field in the configuration form order_in_group: type: integer description: Position of the field in the configuration form (Kafka 4.x name, alias of order) required: type: boolean description: Defines if the field value is mandatory or not type: type: string description: Configuration value type enum: - STRING - INT - SHORT - LONG - DOUBLE - BOOLEAN - LIST - CLASS - PASSWORD width: type: string description: Expected length of the input value enum: - NONE - SHORT - MEDIUM - LONG required: - default_value - display_name - documentation - group - importance - name - order - order_in_group - required - type - width errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - configuration_schema ServiceKafkaConnectCreateConnectorResponse: type: object description: ServiceKafkaConnectCreateConnectorResponse properties: connector: type: object description: Kafka connector information properties: config: type: object description: Connector configuration parameters properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name name: type: string maxLength: 1024 description: Connector name plugin: type: object description: Kafka Connector plugin information properties: author: type: string description: Connector author name available_versions: type: array description: Versions available on the service items: type: object properties: deprecated: type: boolean description: If the version is deprecated. needs_maintenance: type: boolean description: Using this version requires a maintenance update. version: type: string description: Connector version number class: type: string description: Connector class name docURL: type: string description: Connector documentation URL plugin_name: type: string description: Connector plugin name preview: type: boolean description: Describes if connector is in beta preview_info: type: string description: Information about beta stage of connector title: type: string description: Descriptive human readable name defined by Aiven type: type: string description: Describes whether data flows from or to Kafka enum: - sink - source - unknown version: type: string description: Connector version number required: - author - class - docURL - title - type - version tasks: type: array description: List of tasks of a connector items: type: object properties: connector: type: string description: Related connector name task: type: integer description: Task id / number required: - connector - task required: - config - name - plugin - tasks errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - connector ServiceSchemaRegistryAclAddRequestBody: type: object description: ServiceSchemaRegistryAclAddRequestBody properties: permission: type: string description: ACL entry for Schema Registry enum: - schema_registry_read - schema_registry_write resource: type: string minLength: 1 maxLength: 249 description: Schema Registry ACL entry resource name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - resource - username ServiceKafkaAclAddRequestBody: type: object description: ServiceKafkaAclAddRequestBody properties: permission: type: string description: Kafka permission enum: - admin - read - readwrite - write topic: type: string minLength: 1 maxLength: 249 description: Topic name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - topic - username ServiceKafkaConnectStopConnectorResponse: type: object description: ServiceKafkaConnectStopConnectorResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistryCompatibilityRequestBody: type: object description: ServiceSchemaRegistryCompatibilityRequestBody properties: schema: type: string maxLength: 1048576 description: Schema schemaType: type: string description: Schema type enum: - AVRO - JSON - PROTOBUF required: - schema ServiceKafkaConnectRestartConnectorResponse: type: object description: ServiceKafkaConnectRestartConnectorResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistrySubjectConfigPutResponse: type: object description: ServiceSchemaRegistrySubjectConfigPutResponse properties: compatibility: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - compatibility ServiceKafkaConnectGetAvailableConnectorsResponse: type: object description: ServiceKafkaConnectGetAvailableConnectorsResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request plugins: type: array description: List of available Kafka Connect connector plugins items: type: object properties: author: type: string description: Connector author name available_versions: type: array description: Versions available on the service items: type: object properties: deprecated: type: boolean description: If the version is deprecated. needs_maintenance: type: boolean description: Using this version requires a maintenance update. version: type: string description: Connector version number class: type: string description: Connector class name docURL: type: string description: Connector documentation URL plugin_name: type: string description: Connector plugin name preview: type: boolean description: Describes if connector is in beta preview_info: type: string description: Information about beta stage of connector title: type: string description: Descriptive human readable name defined by Aiven type: type: string description: Describes whether data flows from or to Kafka enum: - sink - source - unknown version: type: string description: Connector version number required: - author - class - docURL - title - type - version required: - plugins ServiceSchemaRegistryGlobalConfigGetResponse: type: object description: ServiceSchemaRegistryGlobalConfigGetResponse properties: compatibilityLevel: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - compatibilityLevel ServiceSchemaRegistryGlobalConfigPutResponse: type: object description: ServiceSchemaRegistryGlobalConfigPutResponse properties: compatibility: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - compatibility ServiceKafkaNativeAclAddRequestBody: type: object description: ServiceKafkaNativeAclAddRequestBody properties: host: type: string minLength: 0 maxLength: 256 description: the host or * for all hosts operation: type: string description: Kafka ACL operation represents an operation which an ACL grants or denies permission to perform enum: - All - Alter - AlterConfigs - ClusterAction - Create - CreateTokens - Delete - Describe - DescribeConfigs - DescribeTokens - IdempotentWrite - Read - Write pattern_type: type: string description: Kafka ACL pattern type of resource name default: LITERAL enum: - LITERAL - PREFIXED permission_type: type: string description: Kafka ACL permission type default: ALLOW enum: - ALLOW - DENY principal: type: string minLength: 0 maxLength: 256 description: principal is in 'PrincipalType:name' format resource_name: type: string minLength: 0 maxLength: 256 description: Resource pattern used to match specified resources resource_type: type: string description: Kafka ACL resource type represents a type of resource which an ACL can be applied to enum: - Cluster - DelegationToken - Group - Topic - TransactionalId - User required: - operation - pattern_type - permission_type - principal - resource_name - resource_type ServiceKafkaConnectRestartConnectorTaskResponse: type: object description: ServiceKafkaConnectRestartConnectorTaskResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaConnectEditConnectorRequestBody: type: object description: ServiceKafkaConnectEditConnectorRequestBody properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name ServiceKafkaTopicMessageListRequestBody: type: object description: ServiceKafkaTopicMessageListRequestBody properties: format: type: string description: The format of consumed messages, which is used to convert messages into a JSON-compatible form. If unspecified, defaults to binary enum: - binary - json - avro - protobuf - jsonschema max_bytes: type: integer minimum: 1024 maximum: 1000000000 description: The maximum number of bytes of unencoded keys and values that should be included in the response. This provides approximate control over the size of responses and the amount of memory required to store the decoded response. The actual limit will be the minimum of this setting and the server-side configuration consumer.request.max.bytes. Default is unlimited partitions: type: object description: Object of desired partition / offset mappings properties: {} timeout: type: integer minimum: 3000 maximum: 40000 description: The maximum total time to wait for messages for a request if the maximum request size has not yet been reached required: - partitions ServiceSchemaRegistrySubjectVersionPostResponse: type: object description: ServiceSchemaRegistrySubjectVersionPostResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status id: type: integer minimum: 0 description: Schema Id message: type: string description: Printable result of the request required: - id ServiceKafkaTopicCreateRequestBody: type: object description: ServiceKafkaTopicCreateRequestBody properties: cleanup_policy: type: string description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: 'DEPRECATED: use config.cleanup_policy' enum: - delete - compact - compact,delete config: type: object description: Kafka topic configuration properties: cleanup_policy: type: string description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: cleanup.policy enum: - delete - compact - compact,delete compression_type: type: string description: Specify the final compression type for a given topic. This configuration accepts the standard compression codecs ('gzip', 'snappy', 'lz4', 'zstd'). It additionally accepts 'uncompressed' which is equivalent to no compression; and 'producer' which means retain the original compression codec set by the producer. title: compression.type enum: - snappy - gzip - lz4 - producer - uncompressed - zstd delete_retention_ms: type: integer minimum: 0 description: The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage (otherwise delete tombstones may be collected before they complete their scan). title: delete.retention.ms diskless_enable: type: boolean description: Indicates whether diskless should be enabled. This is only available for BYOC services with Diskless feature enabled. title: diskless.enable file_delete_delay_ms: type: integer minimum: 0 description: The time to wait before deleting a file from the filesystem. title: file.delete.delay.ms flush_messages: type: integer minimum: 0 description: This setting allows specifying an interval at which we will force an fsync of data written to the log. For example if this was set to 1 we would fsync after every message; if it were 5 we would fsync after every five messages. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.messages flush_ms: type: integer minimum: 0 description: This setting allows specifying a time interval at which we will force an fsync of data written to the log. For example if this was set to 1000 we would fsync after 1000 ms had passed. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.ms index_interval_bytes: type: integer minimum: 0 description: This setting controls how frequently Kafka adds an index entry to its offset index. The default setting ensures that we index a message roughly every 4096 bytes. More indexing allows reads to jump closer to the exact position in the log but makes the index larger. You probably don't need to change this. title: index.interval.bytes local_retention_bytes: type: integer description: This configuration controls the maximum bytes tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the limit is equal to overall retention time. If set to -1, no limit is applied but it's possible only if overall retention is also -1. title: local.retention.bytes local_retention_ms: type: integer description: This configuration controls the maximum time tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the time limit is equal to overall retention time. If set to -1, no time limit is applied but it's possible only if overall retention is also -1. title: local.retention.ms max_compaction_lag_ms: type: integer minimum: 0 description: The maximum time a message will remain ineligible for compaction in the log. Only applicable for logs that are being compacted. title: max.compaction.lag.ms max_message_bytes: type: integer minimum: 0 description: The largest record batch size allowed by Kafka (after compression if compression is enabled). If this is increased and there are consumers older than 0.10.2, the consumers' fetch size must also be increased so that the they can fetch record batches this large. In the latest message format version, records are always grouped into batches for efficiency. In previous message format versions, uncompressed records are not grouped into batches and this limit only applies to a single record in that case. title: max.message.bytes message_downconversion_enable: type: boolean description: This configuration controls whether down-conversion of message formats is enabled to satisfy consume requests. When set to false, broker will not perform down-conversion for consumers expecting an older message format. The broker responds with UNSUPPORTED_VERSION error for consume requests from such older clients. This configuration does not apply to any message format conversion that might be required for replication to followers. title: message.downconversion.enable message_format_version: type: string description: 'Specify the message format version the broker will use to append messages to the logs. The value should be a valid ApiVersion. Some examples are: 0.8.2, 0.9.0.0, 0.10.0, check ApiVersion for more details. By setting a particular message format version, the user is certifying that all the existing messages on disk are smaller or equal than the specified version. Setting this value incorrectly will cause consumers with older versions to break as they will receive messages with a format that they don''t understand. Deprecated in Kafka 4.0+: this configuration is removed and any supplied value will be ignored; for services upgraded to 4.0+, the returned value may be ''None''.' title: message.format.version enum: - 0.8.0 - 0.8.1 - 0.8.2 - 0.9.0 - 0.10.0 - 0.10.0-IV0 - 0.10.0-IV1 - 0.10.1 - 0.10.1-IV0 - 0.10.1-IV1 - 0.10.1-IV2 - 0.10.2 - 0.10.2-IV0 - 0.11.0 - 0.11.0-IV0 - 0.11.0-IV1 - 0.11.0-IV2 - '1.0' - 1.0-IV0 - '1.1' - 1.1-IV0 - '2.0' - 2.0-IV0 - 2.0-IV1 - '2.1' - 2.1-IV0 - 2.1-IV1 - 2.1-IV2 - '2.2' - 2.2-IV0 - 2.2-IV1 - '2.3' - 2.3-IV0 - 2.3-IV1 - '2.4' - 2.4-IV0 - 2.4-IV1 - '2.5' - 2.5-IV0 - '2.6' - 2.6-IV0 - '2.7' - 2.7-IV0 - 2.7-IV1 - 2.7-IV2 - '2.8' - 2.8-IV0 - 2.8-IV1 - '3.0' - 3.0-IV0 - 3.0-IV1 - '3.1' - 3.1-IV0 - '3.2' - 3.2-IV0 - '3.3' - 3.3-IV0 - 3.3-IV1 - 3.3-IV2 - 3.3-IV3 - '3.4' - 3.4-IV0 - '3.5' - 3.5-IV0 - 3.5-IV1 - 3.5-IV2 - '3.6' - 3.6-IV0 - 3.6-IV1 - 3.6-IV2 - '3.7' - 3.7-IV0 - 3.7-IV1 - 3.7-IV2 - 3.7-IV3 - 3.7-IV4 - '3.8' - 3.8-IV0 - '3.9' - 3.9-IV0 - 3.9-IV1 - '4.0' - 4.0-IV0 - '4.1' - 4.1-IV0 - '4.2' - 4.2-IV0 message_timestamp_after_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps later than the broker's timestamp. title: message.timestamp.after.max.ms message_timestamp_before_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps earlier than the broker's timestamp. title: message.timestamp.before.max.ms message_timestamp_difference_max_ms: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. This configuration is ignored if message.timestamp.type=LogAppendTime. title: message.timestamp.difference.max.ms message_timestamp_type: type: string description: Define whether the timestamp in the message is message create time or log append time. title: message.timestamp.type enum: - CreateTime - LogAppendTime min_cleanable_dirty_ratio: type: number minimum: 0 maximum: 1 description: 'This configuration controls how frequently the log compactor will attempt to clean the log (assuming log compaction is enabled). By default we will avoid cleaning a log where more than 50% of the log has been compacted. This ratio bounds the maximum space wasted in the log by duplicates (at 50% at most 50% of the log could be duplicates). A higher ratio will mean fewer, more efficient cleanings but will mean more wasted space in the log. If the max.compaction.lag.ms or the min.compaction.lag.ms configurations are also specified, then the log compactor considers the log to be eligible for compaction as soon as either: (i) the dirty ratio threshold has been met and the log has had dirty (uncompacted) records for at least the min.compaction.lag.ms duration, or (ii) if the log has had dirty (uncompacted) records for at most the max.compaction.lag.ms period.' title: min.cleanable.dirty.ratio min_compaction_lag_ms: type: integer minimum: 0 description: The minimum time a message will remain uncompacted in the log. Only applicable for logs that are being compacted. title: min.compaction.lag.ms min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: min.insync.replicas preallocate: type: boolean description: True if we should preallocate the file on disk when creating a new log segment. title: preallocate remote_storage_enable: type: boolean description: Indicates whether tiered storage should be enabled. This is only available for services with Tiered Storage feature enabled. title: remote.storage.enable retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: retention.bytes retention_ms: type: integer description: This configuration controls the maximum time we will retain a log before we will discard old log segments to free up space if we are using the 'delete' retention policy. This represents an SLA on how soon consumers must read their data. If set to -1, no time limit is applied. title: retention.ms segment_bytes: type: integer minimum: 14 description: This configuration controls the segment file size for the log. Retention and cleaning is always done a file at a time so a larger segment size means fewer files but less granular control over retention. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 megabytes. title: segment.bytes segment_index_bytes: type: integer minimum: 0 description: This configuration controls the size of the index that maps offsets to file positions. We preallocate this index file and shrink it only after log rolls. You generally should not need to change this setting. title: segment.index.bytes segment_jitter_ms: type: integer minimum: 0 description: The maximum random jitter subtracted from the scheduled segment roll time to avoid thundering herds of segment rolling title: segment.jitter.ms segment_ms: type: integer minimum: 1 description: This configuration controls the period of time after which Kafka will force the log to roll even if the segment file isn't full to ensure that retention can delete or compact old data. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 seconds. title: segment.ms unclean_leader_election_enable: type: boolean description: Indicates whether to enable replicas not in the ISR set to be elected as leader as a last resort, even though doing so may result in data loss. title: unclean.leader.election.enable min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: 'DEPRECATED: use config.min_insync_replicas' owner_user_group_id: type: string minLength: 1 maxLength: 36 description: The user group that owns this topic partitions: type: integer minimum: 1 maximum: 1000000 description: Number of partitions replication: type: integer minimum: 1 description: Number of replicas retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: 'DEPRECATED: use config.retention_bytes' retention_hours: type: integer maximum: 2562047788015 description: 'DEPRECATED: use config.retention_ms' tags: type: array minItems: 0 maxItems: 25 description: Topic tags items: type: object properties: key: type: string minLength: 1 maxLength: 64 description: Tag key value: type: string minLength: 0 maxLength: 256 description: Tag value required: - key - value topic_description: type: string minLength: 1 maxLength: 256 description: Topic description topic_name: type: string minLength: 1 maxLength: 249 description: Topic name required: - topic_name ServiceSchemaRegistrySubjectVersionSchemaGetResponse: type: object description: ServiceSchemaRegistrySubjectVersionSchemaGetResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaTieredStorageStorageUsageTotalResponse: type: object description: ServiceKafkaTieredStorageStorageUsageTotalResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request total_storage_usage: type: integer minimum: 0 description: Total storage usage by tiered storage, in bytes required: - total_storage_usage ServiceSchemaRegistrySubjectVersionPostRequestBody: type: object description: ServiceSchemaRegistrySubjectVersionPostRequestBody properties: references: type: array maxItems: 128 description: Schema references items: type: object properties: name: type: string maxLength: 1024 description: The name used to reference the provided subject and version title: Name subject: type: string maxLength: 1024 description: Subject version: type: integer minimum: 0 description: Version required: - name - subject - version schema: type: string maxLength: 1048576 description: Schema schemaType: type: string description: Schema type enum: - AVRO - JSON - PROTOBUF required: - schema ServiceKafkaConnectListResponse: type: object description: ServiceKafkaConnectListResponse properties: connectors: type: array description: List of active Kafka Connect connectors items: type: object properties: config: type: object description: Connector configuration parameters properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name name: type: string maxLength: 1024 description: Connector name plugin: type: object description: Kafka Connector plugin information properties: author: type: string description: Connector author name available_versions: type: array description: Versions available on the service items: type: object properties: deprecated: type: boolean description: If the version is deprecated. needs_maintenance: type: boolean description: Using this version requires a maintenance update. version: type: string description: Connector version number class: type: string description: Connector class name docURL: type: string description: Connector documentation URL plugin_name: type: string description: Connector plugin name preview: type: boolean description: Describes if connector is in beta preview_info: type: string description: Information about beta stage of connector title: type: string description: Descriptive human readable name defined by Aiven type: type: string description: Describes whether data flows from or to Kafka enum: - sink - source - unknown version: type: string description: Connector version number required: - author - class - docURL - title - type - version tasks: type: array description: List of tasks of a connector items: type: object properties: connector: type: string description: Related connector name task: type: integer description: Task id / number required: - connector - task required: - config - name - plugin - tasks errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status failed_connectors: type: array description: List of connectors that failed plugin resolution items: type: object properties: config: type: object description: Connector configuration parameters properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name error: type: string description: Error message explaining why the connector failed to load name: type: string maxLength: 1024 description: Connector name required: - config - error - name message: type: string description: Printable result of the request required: - connectors ServiceKafkaTopicListResponse: type: object description: ServiceKafkaTopicListResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request topics: type: array description: List of Kafka topics items: type: object properties: cleanup_policy: type: string maxLength: 64 description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: cleanup.policy diskless_enable: type: boolean description: Indicates whether diskless should be enabled. This is only available for BYOC services with Diskless feature enabled. title: diskless.enable min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: min.insync.replicas owner_user_group_id: type: string minLength: 1 maxLength: 36 description: The user group that owns this topic partitions: type: integer minimum: 1 maximum: 1000000 description: Number of partitions remote_storage_enable: type: boolean description: Indicates whether tiered storage should be enabled. This is only available for services with Tiered Storage feature enabled. title: remote.storage.enable replication: type: integer minimum: 1 description: Number of replicas retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: retention.bytes retention_hours: type: integer maximum: 2562047788015 description: Retention period (hours) state: type: string description: Topic state enum: - ACTIVE - CONFIGURING - DELETING tags: type: array minItems: 0 maxItems: 25 description: Topic tags items: type: object properties: key: type: string minLength: 1 maxLength: 64 description: Tag key value: type: string minLength: 0 maxLength: 256 description: Tag value required: - key - value topic_description: type: string minLength: 1 maxLength: 256 description: Topic description topic_name: type: string minLength: 1 maxLength: 249 description: Topic name required: - cleanup_policy - min_insync_replicas - owner_user_group_id - partitions - replication - retention_bytes - retention_hours - state - tags - topic_description - topic_name required: - topics ServiceSchemaRegistryAclAddResponse: type: object description: ServiceSchemaRegistryAclAddResponse properties: acl: type: array description: List of Schema Registry ACL entries items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: ACL entry for Schema Registry enum: - schema_registry_read - schema_registry_write resource: type: string minLength: 1 maxLength: 249 description: Schema Registry ACL entry resource name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - resource - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceSchemaRegistrySubjectConfigPutRequestBody: type: object description: ServiceSchemaRegistrySubjectConfigPutRequestBody properties: compatibility: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE required: - compatibility ServiceKafkaAclListResponse: type: object description: ServiceKafkaAclListResponse properties: acl: type: array description: List of Aiven ACL entries for Kafka service items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: Kafka permission enum: - admin - read - readwrite - write topic: type: string minLength: 1 maxLength: 249 description: Topic name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - topic - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceKafkaQuotaDeleteResponse: type: object description: ServiceKafkaQuotaDeleteResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistrySubjectConfigGetResponse: type: object description: ServiceSchemaRegistrySubjectConfigGetResponse properties: compatibilityLevel: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - compatibilityLevel ServiceSchemaRegistrySubjectsResponse: type: object description: ServiceSchemaRegistrySubjectsResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request subjects: type: array description: List of available Schema Registry subjects items: type: string required: - subjects ServiceKafkaConnectCreateConnectorRequestBody: type: object description: ServiceKafkaConnectCreateConnectorRequestBody properties: connector.class: type: string maxLength: 1024 description: The Java class for the connector name: type: string maxLength: 1024 description: Unique name for the connector required: - connector.class - name ServiceSchemaRegistryGlobalConfigPutRequestBody: type: object description: ServiceSchemaRegistryGlobalConfigPutRequestBody properties: compatibility: type: string description: Compatibility level enum: - BACKWARD - BACKWARD_TRANSITIVE - FORWARD - FORWARD_TRANSITIVE - FULL - FULL_TRANSITIVE - NONE required: - compatibility ServiceKafkaQuotaDescribeResponse: type: object description: ServiceKafkaQuotaDescribeResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request quota: type: object description: kafka quota properties: client\-id: type: string maxLength: 255 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: client-id consumer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: consumer network throttle producer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: producer network throttle request_percentage: type: number description: Sets the maximum percentage of CPU time that a client group can use on request handler I/O and network threads per broker within a quota window. Exceeding this limit triggers throttling. The quota, expressed as a percentage, also indicates the total allowable CPU usage for the client groups sharing the quota. title: cpu percentage throttle user: type: string maxLength: 64 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: user required: - client\-id - consumer_byte_rate - producer_byte_rate - request_percentage - user required: - quota ServiceKafkaConnectDeleteConnectorResponse: type: object description: ServiceKafkaConnectDeleteConnectorResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaQuotaListResponse: type: object description: ServiceKafkaQuotaListResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request quotas: type: array description: List of kafka quotas items: type: object properties: client\-id: type: string maxLength: 255 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: client-id consumer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: consumer network throttle producer_byte_rate: type: number minimum: 0 maximum: 1073741824 description: Defines the bandwidth limit in bytes/sec for each group of clients sharing a quota. Every distinct client group is allocated a specific quota, as defined by the cluster, on a per-broker basis. Exceeding this limit results in client throttling. title: producer network throttle request_percentage: type: number description: Sets the maximum percentage of CPU time that a client group can use on request handler I/O and network threads per broker within a quota window. Exceeding this limit triggers throttling. The quota, expressed as a percentage, also indicates the total allowable CPU usage for the client groups sharing the quota. title: cpu percentage throttle user: type: string maxLength: 64 description: Represents a logical group of clients, assigned a unique name by the client application. Quotas can be applied based on user, client-id, or both. The most relevant quota is chosen for each connection. All connections within a quota group share the same quota. title: user required: - client\-id - consumer_byte_rate - producer_byte_rate - request_percentage - user required: - quotas ServiceKafkaTopicGetResponse: type: object description: ServiceKafkaTopicGetResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request topic: type: object description: Kafka topic information properties: cleanup_policy: type: string maxLength: 64 description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: 'DEPRECATED: use config.cleanup_policy' config: type: object description: Kafka topic configuration properties: cleanup_policy: type: object description: cleanup.policy value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: string description: Synonym value required: - name - source - value value: type: string maxLength: 64 description: The retention policy to use on old segments. Possible values include 'delete', 'compact', or a comma-separated list of them. The default policy ('delete') will discard old segments when their retention time or size limit has been reached. The 'compact' setting will enable log compaction on the topic. title: cleanup.policy required: - source - value compression_type: type: object description: compression.type value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: string description: Synonym value required: - name - source - value value: type: string description: Specify the final compression type for a given topic. This configuration accepts the standard compression codecs ('gzip', 'snappy', 'lz4', 'zstd'). It additionally accepts 'uncompressed' which is equivalent to no compression; and 'producer' which means retain the original compression codec set by the producer. title: compression.type enum: - snappy - gzip - lz4 - producer - uncompressed - zstd required: - source - value delete_retention_ms: type: object description: delete.retention.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage (otherwise delete tombstones may be collected before they complete their scan). title: delete.retention.ms required: - source - value diskless_enable: type: object description: diskless.enable value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: boolean description: Synonym value required: - name - source - value value: type: boolean description: Indicates whether diskless should be enabled. This is only available for BYOC services with Diskless feature enabled. title: diskless.enable required: - source - value file_delete_delay_ms: type: object description: file.delete.delay.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The time to wait before deleting a file from the filesystem. title: file.delete.delay.ms required: - source - value flush_messages: type: object description: flush.messages value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: This setting allows specifying an interval at which we will force an fsync of data written to the log. For example if this was set to 1 we would fsync after every message; if it were 5 we would fsync after every five messages. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.messages required: - source - value flush_ms: type: object description: flush.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: This setting allows specifying a time interval at which we will force an fsync of data written to the log. For example if this was set to 1000 we would fsync after 1000 ms had passed. In general we recommend you not set this and use replication for durability and allow the operating system's background flush capabilities as it is more efficient. title: flush.ms required: - source - value index_interval_bytes: type: object description: index.interval.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: This setting controls how frequently Kafka adds an index entry to its offset index. The default setting ensures that we index a message roughly every 4096 bytes. More indexing allows reads to jump closer to the exact position in the log but makes the index larger. You probably don't need to change this. title: index.interval.bytes required: - source - value local_retention_bytes: type: object description: local.retention.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer description: This configuration controls the maximum bytes tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the limit is equal to overall retention time. If set to -1, no limit is applied but it's possible only if overall retention is also -1. title: local.retention.bytes required: - source - value local_retention_ms: type: object description: local.retention.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer description: This configuration controls the maximum time tiered storage will retain segment files locally before it will discard old log segments to free up space. If set to -2, the time limit is equal to overall retention time. If set to -1, no time limit is applied but it's possible only if overall retention is also -1. title: local.retention.ms required: - source - value max_compaction_lag_ms: type: object description: max.compaction.lag.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The maximum time a message will remain ineligible for compaction in the log. Only applicable for logs that are being compacted. title: max.compaction.lag.ms required: - source - value max_message_bytes: type: object description: max.message.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The largest record batch size allowed by Kafka (after compression if compression is enabled). If this is increased and there are consumers older than 0.10.2, the consumers' fetch size must also be increased so that the they can fetch record batches this large. In the latest message format version, records are always grouped into batches for efficiency. In previous message format versions, uncompressed records are not grouped into batches and this limit only applies to a single record in that case. title: max.message.bytes required: - source - value message_downconversion_enable: type: object description: message.downconversion.enable value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: boolean description: Synonym value required: - name - source - value value: type: boolean description: This configuration controls whether down-conversion of message formats is enabled to satisfy consume requests. When set to false, broker will not perform down-conversion for consumers expecting an older message format. The broker responds with UNSUPPORTED_VERSION error for consume requests from such older clients. This configuration does not apply to any message format conversion that might be required for replication to followers. title: message.downconversion.enable required: - source - value message_format_version: type: object description: message.format.version value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: string description: Synonym value required: - name - source - value value: type: string description: 'Specify the message format version the broker will use to append messages to the logs. The value should be a valid ApiVersion. Some examples are: 0.8.2, 0.9.0.0, 0.10.0, check ApiVersion for more details. By setting a particular message format version, the user is certifying that all the existing messages on disk are smaller or equal than the specified version. Setting this value incorrectly will cause consumers with older versions to break as they will receive messages with a format that they don''t understand. Deprecated in Kafka 4.0+: this configuration is removed and any supplied value will be ignored; for services upgraded to 4.0+, the returned value may be ''None''.' title: message.format.version enum: - 0.8.0 - 0.8.1 - 0.8.2 - 0.9.0 - 0.10.0 - 0.10.0-IV0 - 0.10.0-IV1 - 0.10.1 - 0.10.1-IV0 - 0.10.1-IV1 - 0.10.1-IV2 - 0.10.2 - 0.10.2-IV0 - 0.11.0 - 0.11.0-IV0 - 0.11.0-IV1 - 0.11.0-IV2 - '1.0' - 1.0-IV0 - '1.1' - 1.1-IV0 - '2.0' - 2.0-IV0 - 2.0-IV1 - '2.1' - 2.1-IV0 - 2.1-IV1 - 2.1-IV2 - '2.2' - 2.2-IV0 - 2.2-IV1 - '2.3' - 2.3-IV0 - 2.3-IV1 - '2.4' - 2.4-IV0 - 2.4-IV1 - '2.5' - 2.5-IV0 - '2.6' - 2.6-IV0 - '2.7' - 2.7-IV0 - 2.7-IV1 - 2.7-IV2 - '2.8' - 2.8-IV0 - 2.8-IV1 - '3.0' - 3.0-IV0 - 3.0-IV1 - '3.1' - 3.1-IV0 - '3.2' - 3.2-IV0 - '3.3' - 3.3-IV0 - 3.3-IV1 - 3.3-IV2 - 3.3-IV3 - '3.4' - 3.4-IV0 - '3.5' - 3.5-IV0 - 3.5-IV1 - 3.5-IV2 - '3.6' - 3.6-IV0 - 3.6-IV1 - 3.6-IV2 - '3.7' - 3.7-IV0 - 3.7-IV1 - 3.7-IV2 - 3.7-IV3 - 3.7-IV4 - '3.8' - 3.8-IV0 - '3.9' - 3.9-IV0 - 3.9-IV1 - '4.0' - 4.0-IV0 - '4.1' - 4.1-IV0 - '4.2' - 4.2-IV0 - None required: - source - value message_timestamp_after_max_ms: type: object description: message.timestamp.after.max.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps later than the broker's timestamp. title: message.timestamp.after.max.ms required: - source - value message_timestamp_before_max_ms: type: object description: message.timestamp.before.max.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. Applies only for messages with timestamps earlier than the broker's timestamp. title: message.timestamp.before.max.ms required: - source - value message_timestamp_difference_max_ms: type: object description: message.timestamp.difference.max.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The maximum difference allowed between the timestamp when a broker receives a message and the timestamp specified in the message. If message.timestamp.type=CreateTime, a message will be rejected if the difference in timestamp exceeds this threshold. This configuration is ignored if message.timestamp.type=LogAppendTime. title: message.timestamp.difference.max.ms required: - source - value message_timestamp_type: type: object description: message.timestamp.type value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: string description: Synonym value required: - name - source - value value: type: string description: Define whether the timestamp in the message is message create time or log append time. title: message.timestamp.type enum: - CreateTime - LogAppendTime required: - source - value min_cleanable_dirty_ratio: type: object description: min.cleanable.dirty.ratio value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: number description: Synonym value required: - name - source - value value: type: number minimum: 0 maximum: 1 description: 'This configuration controls how frequently the log compactor will attempt to clean the log (assuming log compaction is enabled). By default we will avoid cleaning a log where more than 50% of the log has been compacted. This ratio bounds the maximum space wasted in the log by duplicates (at 50% at most 50% of the log could be duplicates). A higher ratio will mean fewer, more efficient cleanings but will mean more wasted space in the log. If the max.compaction.lag.ms or the min.compaction.lag.ms configurations are also specified, then the log compactor considers the log to be eligible for compaction as soon as either: (i) the dirty ratio threshold has been met and the log has had dirty (uncompacted) records for at least the min.compaction.lag.ms duration, or (ii) if the log has had dirty (uncompacted) records for at most the max.compaction.lag.ms period.' title: min.cleanable.dirty.ratio required: - source - value min_compaction_lag_ms: type: object description: min.compaction.lag.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The minimum time a message will remain uncompacted in the log. Only applicable for logs that are being compacted. title: min.compaction.lag.ms required: - source - value min_insync_replicas: type: object description: min.insync.replicas value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: min.insync.replicas required: - source - value preallocate: type: object description: preallocate value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: boolean description: Synonym value required: - name - source - value value: type: boolean description: True if we should preallocate the file on disk when creating a new log segment. title: preallocate required: - source - value remote_storage_enable: type: object description: remote.storage.enable value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: boolean description: Synonym value required: - name - source - value value: type: boolean description: Indicates whether tiered storage should be enabled. This is only available for services with Tiered Storage feature enabled. title: remote.storage.enable required: - source - value retention_bytes: type: object description: retention.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: retention.bytes required: - source - value retention_ms: type: object description: retention.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer description: This configuration controls the maximum time we will retain a log before we will discard old log segments to free up space if we are using the 'delete' retention policy. This represents an SLA on how soon consumers must read their data. If set to -1, no time limit is applied. title: retention.ms required: - source - value segment_bytes: type: object description: segment.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 14 description: This configuration controls the segment file size for the log. Retention and cleaning is always done a file at a time so a larger segment size means fewer files but less granular control over retention. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 megabytes. title: segment.bytes required: - source - value segment_index_bytes: type: object description: segment.index.bytes value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: This configuration controls the size of the index that maps offsets to file positions. We preallocate this index file and shrink it only after log rolls. You generally should not need to change this setting. title: segment.index.bytes required: - source - value segment_jitter_ms: type: object description: segment.jitter.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 0 description: The maximum random jitter subtracted from the scheduled segment roll time to avoid thundering herds of segment rolling title: segment.jitter.ms required: - source - value segment_ms: type: object description: segment.ms value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: integer description: Synonym value required: - name - source - value value: type: integer minimum: 1 description: This configuration controls the period of time after which Kafka will force the log to roll even if the segment file isn't full to ensure that retention can delete or compact old data. Setting this to a very low value has consequences, and the Aiven management plane ignores values less than 10 seconds. title: segment.ms required: - source - value unclean_leader_election_enable: type: object description: unclean.leader.election.enable value, source and synonyms properties: source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config synonyms: type: array description: Configuration synonyms items: type: object properties: name: type: string description: Synonym name source: type: string description: Source of the Kafka topic configuration entry enum: - unknown_config - topic_config - dynamic_broker_config - dynamic_default_broker_config - static_broker_config - default_config - dynamic_broker_logger_config value: type: boolean description: Synonym value required: - name - source - value value: type: boolean description: Indicates whether to enable replicas not in the ISR set to be elected as leader as a last resort, even though doing so may result in data loss. title: unclean.leader.election.enable required: - source - value min_insync_replicas: type: integer minimum: 1 description: When a producer sets acks to 'all' (or '-1'), this configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. If this minimum cannot be met, then the producer will raise an exception (either NotEnoughReplicas or NotEnoughReplicasAfterAppend). When used together, min.insync.replicas and acks allow you to enforce greater durability guarantees. A typical scenario would be to create a topic with a replication factor of 3, set min.insync.replicas to 2, and produce with acks of 'all'. This will ensure that the producer raises an exception if a majority of replicas do not receive a write. title: 'DEPRECATED: use config.min_insync_replicas' owner_user_group_id: type: string minLength: 1 maxLength: 36 description: The user group that owns this topic partitions: type: array description: Topic partitions items: type: object properties: consumer_groups: type: array description: List of Kafka consumer groups items: type: object properties: group_name: type: string description: consumer group offset: type: integer minimum: 0 description: Latest partition message offset required: - group_name - offset earliest_offset: type: integer description: Earliest partition message offset isr: type: integer minimum: 0 description: Number of In Sync Replicas (ISR) latest_offset: type: integer description: Latest partition message offset partition: type: integer description: Partition number remote_size: type: integer minimum: 0 description: Size of tiered data from partition in bytes size: type: integer minimum: 0 description: Size of partition in bytes required: - consumer_groups - earliest_offset - isr - latest_offset - partition - size replication: type: integer minimum: 1 description: Number of replicas retention_bytes: type: integer description: This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the 'delete' retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes. title: 'DEPRECATED: use config.retention_bytes' retention_hours: type: integer maximum: 2562047788015 description: 'DEPRECATED: use config.retention_ms' state: type: string description: Topic state enum: - ACTIVE - CONFIGURING - DELETING tags: type: array minItems: 0 maxItems: 25 description: Topic tags items: type: object properties: key: type: string minLength: 1 maxLength: 64 description: Tag key value: type: string minLength: 0 maxLength: 256 description: Tag value required: - key - value topic_description: type: string minLength: 1 maxLength: 256 description: Topic description topic_name: type: string minLength: 1 maxLength: 249 description: Topic name required: - cleanup_policy - config - min_insync_replicas - owner_user_group_id - partitions - replication - retention_bytes - retention_hours - state - tags - topic_description - topic_name required: - topic ServiceKafkaConnectGetConnectorStatusResponse: type: object description: ServiceKafkaConnectGetConnectorStatusResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request status: type: object description: Connector status information properties: state: type: string description: Current status of the connector enum: - FAILED - PAUSED - RUNNING - STOPPED - UNASSIGNED tasks: type: array description: List of tasks currently running for the connector items: type: object properties: id: type: integer description: Task identifier state: type: string description: Current status of the task enum: - FAILED - PAUSED - RUNNING - STOPPED - UNASSIGNED trace: type: string description: Task error information required: - id - state - trace required: - state - tasks required: - status ServiceKafkaTieredStorageSummaryResponse: type: object description: ServiceKafkaTieredStorageSummaryResponse properties: current_cost: type: string description: The current cost in USD of tiered storage since the beginning of the billing period errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status forecasted_cost: type: string description: The forecasted cost in USD of tiered storage in the billing period forecasted_rate: type: string description: The rate on GBs/hour used to calculate the forecasted cost message: type: string description: Printable result of the request storage_usage_history: type: object description: History of usage and cumulative costs in the billing period properties: hourly: type: array description: History by hour items: type: object properties: estimated_cost: type: string description: The estimated cost in USD of tiered storage for this hour hour_start: type: string maxLength: 36 description: Timestamp in ISO 8601 format, always in UTC peak_stored_bytes: type: integer minimum: 0 description: Peak bytes stored on object storage at this hour required: - hour_start - peak_stored_bytes required: - hourly total_storage_usage: type: integer minimum: 0 description: Total storage usage by tiered storage, in bytes required: - current_cost - forecasted_cost - storage_usage_history - total_storage_usage ServiceKafkaQuotaCreateResponse: type: object description: ServiceKafkaQuotaCreateResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistrySubjectVersionsGetResponse: type: object description: ServiceSchemaRegistrySubjectVersionsGetResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request versions: type: array description: List of available versions for a Schema Registry subject items: type: integer required: - versions ServiceSchemaRegistryAclListResponse: type: object description: ServiceSchemaRegistryAclListResponse properties: acl: type: array description: List of Schema Registry ACL entries items: type: object properties: id: type: string maxLength: 40 description: ID permission: type: string description: ACL entry for Schema Registry enum: - schema_registry_read - schema_registry_write resource: type: string minLength: 1 maxLength: 249 description: Schema Registry ACL entry resource name pattern username: type: string minLength: 1 maxLength: 64 description: Username required: - permission - resource - username errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceKafkaTopicMessageProduceRequestBody: type: object description: ServiceKafkaTopicMessageProduceRequestBody properties: format: type: string description: The format of the content. enum: - binary - json - avro - protobuf - jsonschema key_schema: type: string minLength: 18 maxLength: 2048 description: Full schema encoded as a string (e.g. JSON serialized for Avro data) key_schema_id: type: integer minimum: 1 maximum: 50000 description: ID returned by a previous request using the same schema. This ID corresponds to the ID of the schema in the registry. records: type: array maxItems: 32 description: List of records to produce to the topic items: type: object properties: key: type: object description: Key for the produced record properties: {} partition: type: integer minimum: 0 maximum: 10000 description: Optionally specify the partition where to produce the record value: type: object description: Value for the produced record properties: {} value_schema: type: string minLength: 18 maxLength: 2048 description: Full schema encoded as a string (e.g. JSON serialized for Avro data) value_schema_id: type: integer minimum: 1 maximum: 50000 description: ID returned by a previous request using the same schema. This ID corresponds to the ID of the schema in the registry. required: - format - records ServiceKafkaNativeAclAddResponse: type: object description: ServiceKafkaNativeAclAddResponse properties: acl: type: object description: Kafka-native ACL entry for Kafka service properties: host: type: string minLength: 0 maxLength: 256 description: the host or * for all hosts id: type: string maxLength: 40 description: ID operation: type: string description: Kafka ACL operation represents an operation which an ACL grants or denies permission to perform enum: - All - Alter - AlterConfigs - ClusterAction - Create - CreateTokens - Delete - Describe - DescribeConfigs - DescribeTokens - IdempotentWrite - Read - Write pattern_type: type: string description: Kafka ACL pattern type of resource name enum: - LITERAL - PREFIXED permission_type: type: string description: Kafka ACL permission type enum: - ALLOW - DENY principal: type: string minLength: 0 maxLength: 256 description: principal is in 'principalType:name' format resource_name: type: string minLength: 0 maxLength: 256 description: Resource pattern used to match specified resources resource_type: type: string description: Kafka ACL resource type represents a type of resource which an ACL can be applied to enum: - Cluster - DelegationToken - Group - Topic - TransactionalId - User required: - host - id - operation - pattern_type - permission_type - principal - resource_name - resource_type errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request required: - acl ServiceKafkaTieredStorageStorageUsageByTopicResponse: type: object description: ServiceKafkaTieredStorageStorageUsageByTopicResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request storage_usage: type: object description: Storage usage by tiered storage by topics properties: {} required: - storage_usage ServiceKafkaTopicDeleteResponse: type: object description: ServiceKafkaTopicDeleteResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaNativeAclDeleteResponse: type: object description: ServiceKafkaNativeAclDeleteResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaConnectResumeConnectorResponse: type: object description: ServiceKafkaConnectResumeConnectorResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaTopicCreateResponse: type: object description: ServiceKafkaTopicCreateResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceSchemaRegistrySchemaGetResponse: type: object description: ServiceSchemaRegistrySchemaGetResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status message: type: string description: Printable result of the request ServiceKafkaTopicMessageProduceResponse: type: object description: ServiceKafkaTopicMessageProduceResponse properties: errors: type: array description: List of errors occurred during request processing items: type: object properties: message: type: string description: Printable error message more_info: type: string description: URL to the documentation of the error status: type: integer description: HTTP error status code required: - message - status key_schema_id: type: integer description: The ID for the schema used to produce keys, or null if keys were not used message: type: string description: Printable result of the request offsets: type: array description: List of offsets for the produced record items: type: object properties: error: type: string description: An error message describing why the operation failed, or null if it succeeded error_code: type: integer description: An error code classifying the reason this operation failed, or null if it succeeded. 1 = Non-retriable Kafka exception, 2 = Retriable Kafka exception; the message might be sent successfully if retried offset: type: integer description: Offset of the message, or null if publishing the message failed partition: type: integer description: Partition the message was published to, or null if publishing the message failed value_schema_id: type: integer description: The ID for the schema used to produce values parameters: servicekafkaquotadelete_client-id: in: query name: client-id description: Client ID. schema: type: string required: false servicekafkaquotadelete_user: in: query name: user description: Username. schema: type: string required: false project: in: path name: project description: Project name schema: type: string required: true subject_name: in: path name: subject_name description: Subject name schema: type: string required: true servicekafkaquotadescribe_client-id: in: query name: client-id description: Client ID. schema: type: string required: false topic_name: in: path name: topic_name description: Kafka topic name schema: type: string required: true connector_name: in: path name: connector_name description: Connector name schema: type: string required: true servicekafkaquotadescribe_user: in: query name: user description: Username. schema: type: string required: false service_name: in: path name: service_name description: Service name schema: type: string required: true version_id: in: path name: version_id description: Version Id schema: type: string required: true kafka_acl_id: in: path name: kafka_acl_id description: Kafka ACL ID schema: type: string required: true schema_id: in: path name: schema_id description: Schema Id schema: type: string required: true task_id: in: path name: task_id description: Service task schema: type: string required: true schema_registry_acl_id: in: path name: schema_registry_acl_id description: Kafka Schema Registry ACL ID schema: type: string required: true securitySchemes: tokenAuth: description: 'Header should be of the format `authorization: aivenv1