--- title: Configure an Extract Transform Load \(ETL\) consumer description: Import and process data from your Kafka environment using your existing Robust Transform Engine \(RTE\) configurations. locale: en-US canonical_url: https://www.servicenow.com/docs/r/australia/integrate-applications/integration-hub/configure-etl-consumer.html release: australia product: Integration Hub classification: integration-hub topic_type: task last_updated: "2026-03-12" reading_time_minutes: 2 breadcrumb: [Using Stream Connect for Apache Kafka, Import and stream data, Integration Hub, Workflow Data Fabric] --- # Configure an Extract Transform Load \(ETL\) consumer Import and process data from your Kafka environment using your existing Robust Transform Engine \(RTE\) configurations. ## Before you begin - Role required: integration\_hub\_admin - This consumer requires a Stream Connect subscription. For more information, see [https://www.servicenow.com/now-platform/workflow-data-fabric.html](https://www.servicenow.com/now-platform/workflow-data-fabric.html). - The ServiceNow Stream Connect Installer \[com.glide.hub.stream\_connect.installer\] plugin is required. - This consumer requires a [robust import set transformer](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/integrate-applications/system-import-sets/robust-import-set-transformers.md). ## About this task To configure a consumer, you need to create two records. 1. The consumer record, which specifies how to import and process data. 2. A record for the Kafka stream, which defines the stream of data to your consumer. This task covers the consumer creation. For instructions on creating a Kafka stream, see [Create a Kafka stream](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/integrate-applications/integration-hub/create-kafka-stream.md). ## Procedure 1. Navigate to **All** > **IntegrationHub** > **Consumers** > **ETL Consumer**. 2. Select **New**. 3. In the form, fill in the fields.
| Field | Description |
|---|---|
| Name | Name of the ETL consumer. |
| Robust import set transformer | Name of the robust import set transformer to use to process data. |
| Delivery guarantee | If there's a node failure, option to specify the delivery guarantee for incoming messages. Select one of the following.- **No lost but duplicates**: All messages are delivered at least once. Some messages might be delivered more than once. - **Once or not at all**: A message isn’t delivered more than once. Some messages might not be delivered at all. |
| Serialization format | The serialization format for the message. Select one of the following. - **Plain Text**: Select this option for any plain-text messages. This is the default format. - **Encoded**: Select this option for messages in an Apache Avro format. Converting plain-text messages to an Avro format requires a schema. Select the schema registry in the **Schema registry** field. For more information on schemas, see [Schema management in Stream Connect](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/integrate-applications/integration-hub/schema-management.md). |
| Data in single column | Option to have the import set table store data in single column. |
| Column mapping | Option to specify whether the message's JSON key maps the data to the column's name or label in the import set table. Select one of the following.- **Label** - **Column name** This field appears only when the **Data in a single column** check box is cleared. |
| Application | Application scope for the ETL Consumer. |
| Schema registry | Registry for the selected schema. Select one of the following. - **Standalone Schema Registry** - **Confluent Schema Registry** This field appears only when the **Serialization format** is set to **Encoded**. For the Confluent Schema Registry, if the received message's schema ID isn't in the schema table, the system imports the schema dynamically, using the configured REST connection. |