Get Confluent | Sign up for
Confluent Cloud
or download
Confluent Platform
Home
Platform
Cloud
Connectors
Tools
Clients
Download Confluent
Back to home
CONFLUENT PLATFORM
Overview
Get Started
What is Confluent Platform?
Apache Kafka Quick Start
Overview
Quick Start for Apache Kafka using Confluent Platform (Local)
Quick Start for Apache Kafka using Confluent Platform (Docker)
Quick Start for Apache Kafka using Confluent Platform Community Components (Local)
Quick Start for Apache Kafka using Confluent Platform Community Components (Docker)
Kafka Basics on Confluent Platform
Introduction to Kafka
Kafka Design
Videos, Demos, and Reading Material
Overview
Confluent Platform Demo (cp-demo)
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Tutorial: Introduction to Streaming Application Development
Confluent Cloud Examples
Overview
ccloud-stack Utility for Confluent Cloud
Tutorial: Confluent Cloud CLI
Code Examples for Apache Kafka®
Apache Kafka commands
C (librdkafka)
Clojure
Confluent CLI
Confluent Cloud CLI
.NET
Go
Groovy
Java
Java Spring Boot
Kafka Connect Datagen
kafkacat
Kotlin
KSQL Datagen
Node.js
Python
REST Proxy
Ruby
Rust
Scala
On-Prem Kafka to Cloud
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Cloud ETL Example
Tutorial: Introduction to Streaming Application Development
Google Kubernetes Engine to Confluent Cloud with Confluent Replicator
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Confluent Replicator to Confluent Cloud Configurations
Confluent Platform on Google Kubernetes Engine
Confluent Platform on Azure Kubernetes Service
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Clickstream Data Analysis Pipeline Using ksqlDB
RBAC Example
Replicator Schema Translation Example
Build Your Own Apache Kafka® Demos
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Install and Upgrade
On-Premises Deployments
Overview
ZIP and TAR
Ubuntu and Debian
RHEL and CentOS
Docker
Install using Docker
Docker Configuration Parameters
Docker Image Reference
Docker Security
System Requirements
Confluent Platform Licenses
Upgrade
Supported Versions and Interoperability
Using Confluent Platform systemd Service Unit Files
Confluent Platform Packages
Migrate to Confluent Platform
Migrate an Existing Kafka Deployment
Migrate to Confluent Server
Build Applications
Command Line Tools
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Kafka Clients
Overview
Kafka Consumer
Kafka Producer
JMS Client
Overview
JMS Client Installation
JMS Client Development Guide
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Application Development
Overview
kafkacat Utility
Docker Developer Guide
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Connector Developer Guide
MQTT Proxy
Introduction
Communication Security Settings
MQTT Proxy Configuration Options
ksqlDB Developer Guide
Pipelining with Kafka Connect and Kafka Streams
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
ksqlDB and Kafka Streams
ksqlDB
ksqlDB Overview
ksqlDB Quickstart
Install ksqlDB
Operate ksqlDB
Upgrade ksqlDB
Develop applications for ksqlDB
Run ksqlDB in Confluent Cloud
Connect ksqlDB to Confluent Cloud
Pull queries preview with Confluent Cloud ksqlDB
Migrate Confluent Cloud ksqlDB applications
Run ksqlDB in Confluent Control Center
Connect ksqlDB to Confluent Control Center
Secure ksqlDB with RBAC
Frequently Asked Questions
Troubleshoot ksqlDB issues
Tutorials and Examples
Examples Overview
ksqlDB quick start
Write streaming queries using ksqlDB (local)
Write streaming queries using ksqlDB and Confluent Control Center
Materialized view/cache
Streaming ETL pipeline
Event-driven microservice
ksqlDB with Embedded Connect
Clickstream Data Analysis Pipeline Using ksqlDB
Integrate with PostgreSQL
Kafka Tutorials using ksqlDB
Stream Processing Cookbook
Examples
Kafka Streams
Kafka Streams Overview
Introduction
Kafka Streams Quick Start
Tutorial: Introduction to Streaming Application Development
Kafka Streams Demo Application
Connect Confluent Platform Components to Confluent Cloud
Streams Concepts
Streams Architecture
Streams Code Examples
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Pipelining with Kafka Connect and Kafka Streams
Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
Streams Upgrade Guide
Streams FAQ
Streams Javadocs
Integrate External Systems to Kafka
Overview
Getting Started with Kafka Connect
Connect Kafka Connect to Confluent Cloud
Connectors to Kafka
Connector Developer Guide
Tutorial: Moving Data In and Out of Kafka
Kafka Connect Concepts
Kafka Connect Reference
Connect Javadocs
Connect REST Interface
Worker Configuration Properties
Connector Configuration Properties
Kafka Connect Licensing
Kafka Connect Monitoring
Kafka Connect Logging
Kafka Connect Transformations
Overview
Cast
Drop
ExtractField
ExtractTopic
Filter (Apache Kafka)
Filter (Confluent)
Flatten
HoistField
InsertField
MaskField
MessageTimestampRouter
RegexRouter
ReplaceField
SetSchemaMetadata
TimestampConverter
TimestampRouter
TombstoneHandler
ValueToKey
Custom transformations
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
Kafka Connect Architecture
Kafka Connect FAQ
Schema Management
Overview
Installing and Configuring
Overview
Configuration Options
Run in Production
Connect to Confluent Cloud
Migrate Schemas
Schema Registry Tutorials
Tutorials Overview
On-Premises
Confluent Cloud
Schema Validation
Monitoring
Single and Multi-Datacenter Setup
Schema Evolution and Compatibility
Schemas in Control Center
Schemas on Confluent Cloud
Migrate Schemas
Deleting Schemas
Security
Schema Registry Security Overview
Role-Based Access Control
Schema Registry Security Plugin
Overview
Install and Configure
Schema Registry Authorization
Supported Operations and Resources
Role-Based Access Control
Schema Registry ACL Authorizer
Topic ACL Authorizer
Developer Guide
Overview
Maven Plugin
API Reference
API Usage Examples
Schema Formats
Formats, Serializers, and Deserializers
Avro
Protobuf
JSON Schema
Integrate Schemas from Connectors
Changelog
Security
General Security
Security Overview
Security Tutorial
Metadata Service (MDS)
Configure Metadata Service (MDS)
Metadata Service Configuration Options
Configure LDAP Authentication
Configure LDAP Group-Based Authorization for MDS
Configure Kerberos Authentication for Brokers Running MDS
Configure MDS to Manage Centralized Audit Logs
Configure mTLS Authentication and RBAC for Kafka Brokers
Cluster Registry
Security Compliance
Prefixes for Configuring Security
Authentication
Authentication with SASL
Authentication with SASL using JAAS
Configuring GSSAPI
Configuring OAUTHBEARER
Configuring PLAIN
Configuring SCRAM
Authentication using Delegation Tokens
Configuring Client Authentication with LDAP
Encryption and Authentication with SSL
HTTP Basic Auth
Adding security to a running cluster
Authorization
Authorization using Role-Based Access Control
RBAC Overview
Quick Start
Predefined Roles
Confluent Server Authorizer
Overview
Configuring the Confluent Server Authorizer
Enable RBAC in a Running Cluster
Discover Identifiers for Clusters
Configuring Token Authentication
Confluent Metadata API Reference
RBAC Example
Configure RBAC using the REST API
ACLs
Authorization using centralized ACLs
Authorization using ACLs
Confluent LDAP Authorizer Overview
Confluent LDAP Authorizer
Using the Confluent LDAP Authorizer
Configuring the LDAP Authorizer
Configure LDAP Authentication
Data Protection
Audit Logs
Audit Log Concepts
Configuring Audit Logs using the CLI
Configure MDS to Manage Centralized Audit Logs
MDS API Audit Log Configuration
Configuring Audit Logs using the Properties File
Encryption with SSL
Secrets
Secrets Management
Tutorial: Secret Protection
Component Security
Confluent Control Center Security
Confluent Control Center Security
Configuring SSL
Control Center Configuring SASL
Control Center UI Authentication
Configuring Control Center to work with Kafka ACLs
Configuring Control Center with LDAP authentication
Configure RBAC for Control Center
Manage and view RBAC roles in Control Center
Log in to Control Center when RBAC enabled
Manage RBAC roles with Control Center
View your RBAC roles in Control Center
Streams Security
Schema Registry Security
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
ksqlDB RBAC
REST Proxy Security
REST Proxy Security
REST Proxy Security Plugins
ZooKeeper Security
Security Management Tools
Ansible Playbooks for Confluent Platform
Docker Security
Multi-DC Deployment Architectures
Overview
Replicator for Multi-Datacenter Replication
Replicator Overview
Tutorial: Replicating Data Between Clusters
Demo (Docker)
Download and Install
Configure and Run
Tuning Replicator
Monitoring Replicator
Replicator and Cross-Cluster Failover
Configuration Options
Migrate from MirrorMaker to Replicator
Replicator Verifier
Confluent Replicator to Confluent Cloud Configurations
Multi-Region Clusters
Overview
Tutorial: Multi-Region Clusters
Cluster Linking Preview
Cluster Linking
Demo (Docker)
Tutorial
Commands
Configuration Options
Metrics and Monitoring
Security
Administer
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Configuration Reference
Broker Configurations
Topic Configurations
Consumer Configurations
Producer Configurations
Connect Configurations
Overview
Sink Configuration Properties
Source Configuration Properties
AdminClient Configurations
License Configurations
Streams Configurations
Docker Configuration Parameters
Control Center Configurations
Streams Configurations
ZooKeeper Configurations
ksqlDB Server Configurations
CLI Tools for Confluent Platform
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Dynamic Configurations
Configure Multi-Node Environment
Confluent Metrics Reporter
Confluent Telemetry Reporter
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
Kafka Operations
Overview
Running Kafka in Production
Dynamic Configurations
Post Kafka Deployment
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Auto Data Balancing
Quick Start
Tutorial (Docker)
Configuration Options for the rebalancer tool
Monitoring Kafka
Confluent Metrics Reporter
kafkacat Utility
Tiered Storage
Docker Operations
Overview
Kafka Monitoring and Metrics Using JMX
Configure Docker Logging
Mounting Docker External Volumes
Post Kafka Deployment
ZooKeeper Operations
Overview
Running ZooKeeper in Production
Kafka Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
ksqlDB Operations
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Monitor and Manage
Monitor and Manage Confluent Platform
Proactive Support
Confluent Telemetry Reporter
Confluent Metrics Reporter
Monitor Kafka
Confluent Control Center
Control Center Overview
Installing and configuring Control Center
Configuring Control Center
Control Center Configuration Reference
Auto-updating the Control Center user interface
Control Center Usage Data Collection
Control Center properties files
Connecting Control Center to Confluent Cloud
Confluent Monitoring Interceptors
Installing Control Center on Kafka
Managing Confluent Platform Licenses
Troubleshooting Control Center
Upgrading Control Center
Control Center User Guide
User Guide Overview
Clusters
Brokers
Topics
Topics Overview
Add topics
View topic metrics
Message Browser
Manage Schemas for Topics
Edit the configuration settings for topics
Delete a topic
Connect
ksqlDB
Consumers
Replicators
Cluster settings
Alerts
Concepts
Configure alerts properties
Configure PagerDuty email integration with Control Center alerts
Alerts navigation
Trigger management
Actions management
Example triggers and actions
REST API for alerts history
Troubleshooting alerts
System Health (deprecated view)
Data streams monitoring (deprecated view)
Confluent Control Center Security
Changelog
Control Center Changelog
Auto-Updating User Interface Changelog
Configure Docker Logging
Monitor Streams Applications
Resources
Release Notes
6.1.0 Release Notes
Component Changelogs
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Control Center Changelog
¶
Version 6.0.1
¶
Added the ability to search by Cluster id on the Clusters home screen.
Added Cluster ID as a read-only field under Cluster settings.
Added detailed syntax validation errors in the schema editor UI.
Added additional helpful tooltips to topic creation flow.
Added support for friendly cluster names on RBAC management screens.
Fixed an issue with tooltip behavior on single-line vs multi-line charts.
Various enhancements and optimizations to the Control Center UI.
Version 6.0.0
¶
Introduced
self-balancing
options on the UI, enabling users to easily balance workloads and dynamically expand and shrink clusters.
Introduced
Tiered Storage
options on the UI, giving users the option to add and scale storage.
Enabled auto-updates to the user interface by default.
Version 5.5.1
¶
Fixed an issue that enabled the “Upload Connector Config file” button for restricted users.
Fixed an issue that enabled the “Set Up Alert” button on the Consumer Group page for restricted users.
Fixed an issue that enabled Connector operations (add, edit, delete, play, pause) for restricted users.
Updated the RequestBuffer default size to allow for larger cookies. This parameter is described on the Control Center Command Reference page under
General settings
.
Various enhancements and optimizations to the Control Center UI.
Version 5.4.0
¶
Added UI for managing RBAC role assignments.
Added Replicator monitoring.
Added Auto-update UI feature.
Added Cluster Overview page.
Added Broker Metrics page.
Added ability to delete topics.
Added ability to upload and download connector configurations.
Added partition size to topic overview page.
Added time series data for offline topic partitions, under replicated partitions, and out-of-sync replicas.
Various enhancements and bug fixes to RBAC enforcement, Connect, KSQL, and License Manager.
Bug fixes for backend HTTP client.
Version 5.3.0
¶
Redesigned the Control Center UI, including KSQL and Connect enhancements. New pages show cluster overview, topics pages, and consumers index.
RBAC enforcement.
Topic message browser enhancements, including jump to timestamp and download results in JSON format.
Alert enhancements that added Slack and PagerDuty webhook notifications, a new Consumer lead alert, pause and resume global alerts actions, and fast navigation to Alerts features from the Alerts bell icon.
Version 5.2.0
¶
Added multiple Connect support.
Added multiple KSQL support.
Added broker configs editing.
Added Schema Registry editing.
Added license management UI.
Improved message browsing.
Improved KSQL UI.
Improved scalability.
Version 5.1.0
¶
Browser support for Chrome, Firefox, and Safari. For more information, see
Web Browsers
.
A new, more readable light theme.
Many bug fixes and UX improvements.
Added configuration confluent.controlcenter.license.manager=_confluent-controlcenter-license-manager-5-1-0. (It was confluent.controlcenter..license.manager = _confluent-controlcenter-license-manager5-1-0 in first 5.1.x release, but it is fixed now.) No need for customers to override this configuration.
Version 5.0.0
¶
Added KSQL interface to create/view streams, tables, and queries.
Added topic inspection to read messages from a topic.
Added consumer group message lag viewing and alerting.
Added Schema Registry viewing.
Added read only view of broker configurations.
Added feature flags for variety of user accessible features.
Version 4.1.0
¶
Added ability to create and edit topics in Control Center.
Added topic filtering and ability to hide Apache Kafka®/Confluent Platform internal topics from the UI.
Added new alert to warn when Control Center stops receiving data from a Kafka cluster.
Added a restricted user type that prevents editing or creating of topics, alerts, or connectors.
Version 4.0.1
¶
Made calls to Connect more resilient.
Fixed an issue that would prevent chart highlighting on System Health charts.
Fixed an issue that could cause Control Center to improperly warn about improper log dirs on brokers.
Fixed an issue that could cause Control Center to improperly alert about active controller count.
Version 4.0.0
¶
Fixed an issue that could cause long request times if a cluster had brokers with noncontiguous IDs.
Additional logging during startup.
Fixed an issue that could cause Control Center to show blank graphs when data was present.
Set and enforce TimestampType for internal Control Center topics at startup.
Fixed an issue that caused us to link to an invalid consumer group on Streams Monitoring.
Fixed an issue where Broker Monitoring could check for data last update time on wrong cluster.
Allow overriding ConfluentMetricsReporter default producer settings.
Allow using a file for
confluent.license
config.
Docker image: allow passing license using CONTROL_CENTER_CONFLUENT_LICENSE environment variable.
Fixed an issue that resulted in Offline and Under Replicated Partitions data to be swapped.
Fixed an issue that could cause Control Center to shutdown if it lost connection to Kafka.
Fixed an issue that could cause Control Center to hang if it encountered an error creating topics on startup.
Version 3.3.1 (EOSL)
¶
Allow text input in date picker.
Fixed an issue that could cause unsubmittable forms.
Show renamed cluster value rather than base clusterid on alerts page.
Added alert banner on Broker Monitoring to indicate a cluster may be down.
Scalability increase for Broker Monitoring to reduce number of messages sent to Kafka.
Fixed an issue where 100% Network Pool Usage was displayed instead of 0%.
Allow graceful shutdown of Control Center during startup.
Fixed a race condition that could happen if you start Control Center and your Kafka broker at the same time.
Version 3.3.0 (EOSL)
¶
Sped up restore time.
Reduced the size of old data over long periods of time.
Upgraded to use new admin client (
KIP-117
).
Alert UI should render better alert information.
Triggers are createable directly though the UI on System Health.
Massive performance improvements to Stream Monitoring UI.
Fixed various time range display/selection bugs; persist time ranges though navigation.
Nonconfigurable form values being sent to Connect via UI should remain and be visible prior to submit.
Version 3.2.2 (EOSL)
¶
Added shutdown script.
Force faster compaction and cleanup on changelog topics.
Several Streams improvements to reduce state-store restoration time after unclean shutdown.
Reduce the volume of data to be restored to state-stores on startup.
Fixed possible concurrency problem in setting RocksDB configuration options.
Fixed possible deadlock on exception after streams startup.
Version 3.2.1 (EOSL)
¶
Enabled HTTP compression by default.
Fixed possible deadlock on streams exception.
Fixed fd leak when communicating with Kafka.
Update defaults for monitoring producers to be more resilient.
Prevent inadvertently creating misconfigured topics during startup during a failure.
Check Kafka version at startup.
Reduce minimum startup time.
More efficient duplicate checking to reduce write amplification.
Handle ‘hidden’ connect configs. This allows Control Center to manage Connectors that do not fully enumerate their configs.
Ensure users only see invalid license warning if their license is invalid.
Fixed topic display bug that would prevent topic details from showing.
Reduced logging in js.
Allow users to close missing data modal dialogs.
Better rendering of System Health metrics especially when some data is missing.
Better validation of triggers, actions, and connector configs.
Faster processing of trigger and action creation and update.
Corrected some misleading labels on System Health.
Better error handling around Connect communications.
Change default timespan in UI to 4 hours.
Check and warn about errors on Topic Management page.
Version 3.2.0 (EOSL)
¶
Add capabilities to monitor brokers instrumented with Confluent Metrics Reporter.
Enable alerting on broker and topic metrics.
Add UI for viewing topic information.
Add status UI for tracking internal progress.
Fixed bug where we could inadvertently show license expired message.
Fixed bugs with alert trigger creation in UI.
Fixed issue with parsing certain error conditions from Connect.
Version 3.1.0 (EOSL)
¶
Enable gathering stream monitoring data from multiple clusters.
Support alerting on stream monitoring conditions.
Ability to restrict UI access via user login.
Version 3.0.1 (EOSL)
¶
Improved data fetching from the browser.
Handle authenticated/authorized Kafka clusters.
Bug fix for running in daemon mode.
More efficient topic creation at startup.
Reduced number of necessary topics/rocksdbs for aggregations.
Reduced total amount of stored data.
Fixed timing issues when receiving delayed data.
Configs updates to prefix Kafka/rest configs.
Added rate limit for logging to prevent logsize blowup.
Allow deleting connector in UI.
On this page: