Get Confluent | Sign up for
Confluent Cloud
or download
Confluent Platform
Home
Platform
Cloud
Connectors
Tools
Clients
Download Confluent
Back to home
CONFLUENT PLATFORM
Overview
Get Started
What is Confluent Platform?
Apache Kafka Quick Start
Overview
Quick Start for Apache Kafka using Confluent Platform (Local)
Quick Start for Apache Kafka using Confluent Platform (Docker)
Quick Start for Apache Kafka using Confluent Platform Community Components (Local)
Quick Start for Apache Kafka using Confluent Platform Community Components (Docker)
Kafka Basics on Confluent Platform
Introduction to Kafka
Kafka Design
Videos, Demos, and Reading Material
Overview
Confluent Platform Demo (cp-demo)
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Tutorial: Introduction to Streaming Application Development
Confluent Cloud Examples
Overview
ccloud-stack Utility for Confluent Cloud
Tutorial: Confluent Cloud CLI
Code Examples for Apache Kafka®
Apache Kafka commands
C (librdkafka)
Clojure
Confluent CLI
Confluent Cloud CLI
.NET
Go
Groovy
Java
Java Spring Boot
Kafka Connect Datagen
kafkacat
Kotlin
KSQL Datagen
Node.js
Python
REST Proxy
Ruby
Rust
Scala
On-Prem Kafka to Cloud
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Cloud ETL Example
Tutorial: Introduction to Streaming Application Development
Google Kubernetes Engine to Confluent Cloud with Confluent Replicator
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Confluent Replicator to Confluent Cloud Configurations
Confluent Platform on Google Kubernetes Engine
Confluent Platform on Azure Kubernetes Service
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Clickstream Data Analysis Pipeline Using ksqlDB
RBAC Example
Replicator Schema Translation Example
Build Your Own Apache Kafka® Demos
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Install and Upgrade
On-Premises Deployments
Overview
ZIP and TAR
Ubuntu and Debian
RHEL and CentOS
Docker
Install using Docker
Docker Configuration Parameters
Docker Image Reference
Docker Security
System Requirements
Confluent Platform Licenses
Upgrade
Supported Versions and Interoperability
Using Confluent Platform systemd Service Unit Files
Confluent Platform Packages
Migrate to Confluent Platform
Migrate an Existing Kafka Deployment
Migrate to Confluent Server
Build Applications
Command Line Tools
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Kafka Clients
Overview
Kafka Consumer
Kafka Producer
JMS Client
Overview
JMS Client Installation
JMS Client Development Guide
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Application Development
Overview
kafkacat Utility
Docker Developer Guide
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Connector Developer Guide
MQTT Proxy
Introduction
Communication Security Settings
MQTT Proxy Configuration Options
ksqlDB Developer Guide
Pipelining with Kafka Connect and Kafka Streams
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
ksqlDB and Kafka Streams
ksqlDB
ksqlDB Overview
ksqlDB Quickstart
Install ksqlDB
Operate ksqlDB
Upgrade ksqlDB
Develop applications for ksqlDB
Run ksqlDB in Confluent Cloud
Connect ksqlDB to Confluent Cloud
Pull queries preview with Confluent Cloud ksqlDB
Migrate Confluent Cloud ksqlDB applications
Run ksqlDB in Confluent Control Center
Connect ksqlDB to Confluent Control Center
Secure ksqlDB with RBAC
Frequently Asked Questions
Troubleshoot ksqlDB issues
Tutorials and Examples
Examples Overview
ksqlDB quick start
Write streaming queries using ksqlDB (local)
Write streaming queries using ksqlDB and Confluent Control Center
Materialized view/cache
Streaming ETL pipeline
Event-driven microservice
ksqlDB with Embedded Connect
Clickstream Data Analysis Pipeline Using ksqlDB
Integrate with PostgreSQL
Kafka Tutorials using ksqlDB
Stream Processing Cookbook
Examples
Kafka Streams
Kafka Streams Overview
Introduction
Kafka Streams Quick Start
Tutorial: Introduction to Streaming Application Development
Kafka Streams Demo Application
Connect Confluent Platform Components to Confluent Cloud
Streams Concepts
Streams Architecture
Streams Code Examples
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Pipelining with Kafka Connect and Kafka Streams
Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
Streams Upgrade Guide
Streams FAQ
Streams Javadocs
Integrate External Systems to Kafka
Overview
Getting Started with Kafka Connect
Connect Kafka Connect to Confluent Cloud
Connectors to Kafka
Connector Developer Guide
Tutorial: Moving Data In and Out of Kafka
Kafka Connect Concepts
Kafka Connect Reference
Connect Javadocs
Connect REST Interface
Worker Configuration Properties
Connector Configuration Properties
Kafka Connect Licensing
Kafka Connect Monitoring
Kafka Connect Logging
Kafka Connect Transformations
Overview
Cast
Drop
ExtractField
ExtractTopic
Filter (Apache Kafka)
Filter (Confluent)
Flatten
HoistField
InsertField
MaskField
MessageTimestampRouter
RegexRouter
ReplaceField
SetSchemaMetadata
TimestampConverter
TimestampRouter
TombstoneHandler
ValueToKey
Custom transformations
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
Kafka Connect Architecture
Kafka Connect FAQ
Schema Management
Overview
Installing and Configuring
Overview
Configuration Options
Run in Production
Connect to Confluent Cloud
Migrate Schemas
Schema Registry Tutorials
Tutorials Overview
On-Premises
Confluent Cloud
Schema Validation
Monitoring
Single and Multi-Datacenter Setup
Schema Evolution and Compatibility
Schemas in Control Center
Schemas on Confluent Cloud
Migrate Schemas
Deleting Schemas
Security
Schema Registry Security Overview
Role-Based Access Control
Schema Registry Security Plugin
Overview
Install and Configure
Schema Registry Authorization
Supported Operations and Resources
Role-Based Access Control
Schema Registry ACL Authorizer
Topic ACL Authorizer
Developer Guide
Overview
Maven Plugin
API Reference
API Usage Examples
Schema Formats
Formats, Serializers, and Deserializers
Avro
Protobuf
JSON Schema
Integrate Schemas from Connectors
Changelog
Security
General Security
Security Overview
Security Tutorial
Metadata Service (MDS)
Configure Metadata Service (MDS)
Metadata Service Configuration Options
Configure LDAP Authentication
Configure LDAP Group-Based Authorization for MDS
Configure Kerberos Authentication for Brokers Running MDS
Configure MDS to Manage Centralized Audit Logs
Configure mTLS Authentication and RBAC for Kafka Brokers
Cluster Registry
Security Compliance
Prefixes for Configuring Security
Authentication
Authentication with SASL
Authentication with SASL using JAAS
Configuring GSSAPI
Configuring OAUTHBEARER
Configuring PLAIN
Configuring SCRAM
Authentication using Delegation Tokens
Configuring Client Authentication with LDAP
Encryption and Authentication with SSL
HTTP Basic Auth
Adding security to a running cluster
Authorization
Authorization using Role-Based Access Control
RBAC Overview
Quick Start
Predefined Roles
Confluent Server Authorizer
Overview
Configuring the Confluent Server Authorizer
Enable RBAC in a Running Cluster
Discover Identifiers for Clusters
Configuring Token Authentication
Confluent Metadata API Reference
RBAC Example
Configure RBAC using the REST API
ACLs
Authorization using centralized ACLs
Authorization using ACLs
Confluent LDAP Authorizer Overview
Confluent LDAP Authorizer
Using the Confluent LDAP Authorizer
Configuring the LDAP Authorizer
Configure LDAP Authentication
Data Protection
Audit Logs
Audit Log Concepts
Configuring Audit Logs using the CLI
Configure MDS to Manage Centralized Audit Logs
MDS API Audit Log Configuration
Configuring Audit Logs using the Properties File
Encryption with SSL
Secrets
Secrets Management
Tutorial: Secret Protection
Component Security
Confluent Control Center Security
Confluent Control Center Security
Configuring SSL
Control Center Configuring SASL
Control Center UI Authentication
Configuring Control Center to work with Kafka ACLs
Configuring Control Center with LDAP authentication
Configure RBAC for Control Center
Manage and view RBAC roles in Control Center
Log in to Control Center when RBAC enabled
Manage RBAC roles with Control Center
View your RBAC roles in Control Center
Streams Security
Schema Registry Security
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
ksqlDB RBAC
REST Proxy Security
REST Proxy Security
REST Proxy Security Plugins
ZooKeeper Security
Security Management Tools
Ansible Playbooks for Confluent Platform
Docker Security
Multi-DC Deployment Architectures
Overview
Replicator for Multi-Datacenter Replication
Replicator Overview
Tutorial: Replicating Data Between Clusters
Demo (Docker)
Download and Install
Configure and Run
Tuning Replicator
Monitoring Replicator
Replicator and Cross-Cluster Failover
Configuration Options
Migrate from MirrorMaker to Replicator
Replicator Verifier
Confluent Replicator to Confluent Cloud Configurations
Multi-Region Clusters
Overview
Tutorial: Multi-Region Clusters
Cluster Linking Preview
Cluster Linking
Demo (Docker)
Tutorial
Commands
Configuration Options
Metrics and Monitoring
Security
Administer
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Configuration Reference
Broker Configurations
Topic Configurations
Consumer Configurations
Producer Configurations
Connect Configurations
Overview
Sink Configuration Properties
Source Configuration Properties
AdminClient Configurations
License Configurations
Streams Configurations
Docker Configuration Parameters
Control Center Configurations
Streams Configurations
ZooKeeper Configurations
ksqlDB Server Configurations
CLI Tools for Confluent Platform
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Dynamic Configurations
Configure Multi-Node Environment
Confluent Metrics Reporter
Confluent Telemetry Reporter
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
Kafka Operations
Overview
Running Kafka in Production
Dynamic Configurations
Post Kafka Deployment
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Auto Data Balancing
Quick Start
Tutorial (Docker)
Configuration Options for the rebalancer tool
Monitoring Kafka
Confluent Metrics Reporter
kafkacat Utility
Tiered Storage
Docker Operations
Overview
Kafka Monitoring and Metrics Using JMX
Configure Docker Logging
Mounting Docker External Volumes
Post Kafka Deployment
ZooKeeper Operations
Overview
Running ZooKeeper in Production
Kafka Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
ksqlDB Operations
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Monitor and Manage
Monitor and Manage Confluent Platform
Proactive Support
Confluent Telemetry Reporter
Confluent Metrics Reporter
Monitor Kafka
Confluent Control Center
Control Center Overview
Installing and configuring Control Center
Configuring Control Center
Control Center Configuration Reference
Auto-updating the Control Center user interface
Control Center Usage Data Collection
Control Center properties files
Connecting Control Center to Confluent Cloud
Confluent Monitoring Interceptors
Installing Control Center on Kafka
Managing Confluent Platform Licenses
Troubleshooting Control Center
Upgrading Control Center
Control Center User Guide
User Guide Overview
Clusters
Brokers
Topics
Topics Overview
Add topics
View topic metrics
Message Browser
Manage Schemas for Topics
Edit the configuration settings for topics
Delete a topic
Connect
ksqlDB
Consumers
Replicators
Cluster settings
Alerts
Concepts
Configure alerts properties
Configure PagerDuty email integration with Control Center alerts
Alerts navigation
Trigger management
Actions management
Example triggers and actions
REST API for alerts history
Troubleshooting alerts
System Health (deprecated view)
Data streams monitoring (deprecated view)
Confluent Control Center Security
Changelog
Control Center Changelog
Auto-Updating User Interface Changelog
Configure Docker Logging
Monitor Streams Applications
Resources
Release Notes
6.1.0 Release Notes
Component Changelogs
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Confluent Platform 6.1.0 Release Notes
¶
On this page: