Connectors to Kafka

Connectors to Kafka

Use connectors to copy data between Apache Kafka® and other systems that you want to pull data from or push data to.

Getting started

Kafka Connect Getting Started

Learn about Kafka Connect and understand how it operates.

Confluent Hub

Online library of pre-packaged extensions or add-ons for Confluent Platform and Kafka.

Connectors general

Self-managed connectors Discover what self-managed connectors are available for Confluent Platform. Managed connectors Discover what managed connectors are available for Confluent Cloud.

Supported connectors Confluent supports many self-managed connectors that import and export data from some of the most commonly used data systems. Practically all connectors are available from Confluent Hub. Preview connectors Confluent introduces preview connectors to gain early feedback from users. Preview connectors are only suitable for evaluation and non-production purposes.

Installing connectors Install the connectors by using the Confluent Hub client (recommended) or manually install by downloading the plugin file. Configuring connectors Connector configurations are key-value mappings. In distributed mode, they are included in the JSON payload sent over the REST API request that creates (or modifies) the connector.

Licensing connectors With a Developer License, you can use Confluent Platform commercial connectors on an unlimited basis in Connect clusters that use a single-broker Apache Kafka® cluster. A 30-day trial period is available when using a multi-broker cluster. Monitoring connectors You can manage and monitor Connect, connectors, and clients using JMX and the REST interface.

Adding connectors or software The Kafka Connect Base image contains Kafka Connect and all of its dependencies. To add new connectors to this image, you need to build a new Docker image that has the new connectors installed. Upgrading a connector plugin Upgrading a connector is similar to upgrading any other Apache Kafka® client application. Refer to the documentation for individual connector plugins if you have a need for rolling upgrades.

Manually installing Community connectors If a connector is not available on Confluent Hub, you can use the JARs to directly install the connectors into your Apache Kafka® installation. Kafka Connect Kafka Connect, an open source component of Apache Kafka®, is a framework for connecting Kafka with external systems such as databases, key-value stores, search indexes, and file systems.