Get Confluent | Sign up for
Confluent Cloud
or download
Confluent Platform
Home
Platform
Cloud
Connectors
Tools
Clients
Download Confluent
Back to home
CONFLUENT PLATFORM
Overview
Get Started
What is Confluent Platform?
Apache Kafka Quick Start
Overview
Quick Start for Apache Kafka using Confluent Platform (Local)
Quick Start for Apache Kafka using Confluent Platform (Docker)
Quick Start for Apache Kafka using Confluent Platform Community Components (Local)
Quick Start for Apache Kafka using Confluent Platform Community Components (Docker)
Kafka Basics on Confluent Platform
Introduction to Kafka
Kafka Design
Videos, Demos, and Reading Material
Overview
Confluent Platform Demo (cp-demo)
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Tutorial: Introduction to Streaming Application Development
Confluent Cloud Examples
Overview
ccloud-stack Utility for Confluent Cloud
Tutorial: Confluent Cloud CLI
Code Examples for Apache Kafka®
Apache Kafka commands
C (librdkafka)
Clojure
Confluent CLI
Confluent Cloud CLI
.NET
Go
Groovy
Java
Java Spring Boot
Kafka Connect Datagen
kafkacat
Kotlin
KSQL Datagen
Node.js
Python
REST Proxy
Ruby
Rust
Scala
On-Prem Kafka to Cloud
cp-demo Overview
On-Prem Tutorial
Hybrid Deployment to Confluent Cloud Tutorial
Teardown
Troubleshooting
Cloud ETL Example
Tutorial: Introduction to Streaming Application Development
Google Kubernetes Engine to Confluent Cloud with Confluent Replicator
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Confluent Replicator to Confluent Cloud Configurations
Confluent Platform on Google Kubernetes Engine
Confluent Platform on Azure Kubernetes Service
Azure Kubernetes Service to Confluent Cloud with Confluent Replicator
Clickstream Data Analysis Pipeline Using ksqlDB
RBAC Example
Replicator Schema Translation Example
Build Your Own Apache Kafka® Demos
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Install and Upgrade
On-Premises Deployments
Overview
ZIP and TAR
Ubuntu and Debian
RHEL and CentOS
Docker
Install using Docker
Docker Configuration Parameters
Docker Image Reference
Docker Security
System Requirements
Confluent Platform Licenses
Upgrade
Supported Versions and Interoperability
Using Confluent Platform systemd Service Unit Files
Confluent Platform Packages
Migrate to Confluent Platform
Migrate an Existing Kafka Deployment
Migrate to Confluent Server
Build Applications
Command Line Tools
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Kafka Clients
Overview
Kafka Consumer
Kafka Producer
JMS Client
Overview
JMS Client Installation
JMS Client Development Guide
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Application Development
Overview
kafkacat Utility
Docker Developer Guide
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Connector Developer Guide
MQTT Proxy
Introduction
Communication Security Settings
MQTT Proxy Configuration Options
ksqlDB Developer Guide
Pipelining with Kafka Connect and Kafka Streams
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
ksqlDB and Kafka Streams
ksqlDB
ksqlDB Overview
ksqlDB Quickstart
Install ksqlDB
Operate ksqlDB
Upgrade ksqlDB
Develop applications for ksqlDB
Run ksqlDB in Confluent Cloud
Connect ksqlDB to Confluent Cloud
Pull queries preview with Confluent Cloud ksqlDB
Migrate Confluent Cloud ksqlDB applications
Run ksqlDB in Confluent Control Center
Connect ksqlDB to Confluent Control Center
Secure ksqlDB with RBAC
Frequently Asked Questions
Troubleshoot ksqlDB issues
Tutorials and Examples
Examples Overview
ksqlDB quick start
Write streaming queries using ksqlDB (local)
Write streaming queries using ksqlDB and Confluent Control Center
Materialized view/cache
Streaming ETL pipeline
Event-driven microservice
ksqlDB with Embedded Connect
Clickstream Data Analysis Pipeline Using ksqlDB
Integrate with PostgreSQL
Kafka Tutorials using ksqlDB
Stream Processing Cookbook
Examples
Kafka Streams
Kafka Streams Overview
Introduction
Kafka Streams Quick Start
Tutorial: Introduction to Streaming Application Development
Kafka Streams Demo Application
Connect Confluent Platform Components to Confluent Cloud
Streams Concepts
Streams Architecture
Streams Code Examples
Streams Developer Guide
Writing a Streams Application
Testing Streams Code
Configuring a Streams Application
Streams DSL
Naming Kafka Streams DSL Topologies
Optimizing Kafka Streams Topologies
Processor API
Data Types and Serialization
Interactive Queries
Memory Management
Running Streams Applications
Managing Streams Application Topics
Streams Security
Application Reset Tool
Pipelining with Kafka Connect and Kafka Streams
Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
Streams Upgrade Guide
Streams FAQ
Streams Javadocs
Integrate External Systems to Kafka
Overview
Getting Started with Kafka Connect
Connect Kafka Connect to Confluent Cloud
Connectors to Kafka
Connector Developer Guide
Tutorial: Moving Data In and Out of Kafka
Kafka Connect Concepts
Kafka Connect Reference
Connect Javadocs
Connect REST Interface
Worker Configuration Properties
Connector Configuration Properties
Kafka Connect Licensing
Kafka Connect Monitoring
Kafka Connect Logging
Kafka Connect Transformations
Overview
Cast
Drop
ExtractField
ExtractTopic
Filter (Apache Kafka)
Filter (Confluent)
Flatten
HoistField
InsertField
MaskField
MessageTimestampRouter
RegexRouter
ReplaceField
SetSchemaMetadata
TimestampConverter
TimestampRouter
TombstoneHandler
ValueToKey
Custom transformations
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
Kafka Connect Architecture
Kafka Connect FAQ
Schema Management
Overview
Installing and Configuring
Overview
Configuration Options
Run in Production
Connect to Confluent Cloud
Migrate Schemas
Schema Registry Tutorials
Tutorials Overview
On-Premises
Confluent Cloud
Schema Validation
Monitoring
Single and Multi-Datacenter Setup
Schema Evolution and Compatibility
Schemas in Control Center
Schemas on Confluent Cloud
Migrate Schemas
Deleting Schemas
Security
Schema Registry Security Overview
Role-Based Access Control
Schema Registry Security Plugin
Overview
Install and Configure
Schema Registry Authorization
Supported Operations and Resources
Role-Based Access Control
Schema Registry ACL Authorizer
Topic ACL Authorizer
Developer Guide
Overview
Maven Plugin
API Reference
API Usage Examples
Schema Formats
Formats, Serializers, and Deserializers
Avro
Protobuf
JSON Schema
Integrate Schemas from Connectors
Changelog
Security
General Security
Security Overview
Security Tutorial
Metadata Service (MDS)
Configure Metadata Service (MDS)
Metadata Service Configuration Options
Configure LDAP Authentication
Configure LDAP Group-Based Authorization for MDS
Configure Kerberos Authentication for Brokers Running MDS
Configure MDS to Manage Centralized Audit Logs
Configure mTLS Authentication and RBAC for Kafka Brokers
Cluster Registry
Security Compliance
Prefixes for Configuring Security
Authentication
Authentication with SASL
Authentication with SASL using JAAS
Configuring GSSAPI
Configuring OAUTHBEARER
Configuring PLAIN
Configuring SCRAM
Authentication using Delegation Tokens
Configuring Client Authentication with LDAP
Encryption and Authentication with SSL
HTTP Basic Auth
Adding security to a running cluster
Authorization
Authorization using Role-Based Access Control
RBAC Overview
Quick Start
Predefined Roles
Confluent Server Authorizer
Overview
Configuring the Confluent Server Authorizer
Enable RBAC in a Running Cluster
Discover Identifiers for Clusters
Configuring Token Authentication
Confluent Metadata API Reference
RBAC Example
Configure RBAC using the REST API
ACLs
Authorization using centralized ACLs
Authorization using ACLs
Confluent LDAP Authorizer Overview
Confluent LDAP Authorizer
Using the Confluent LDAP Authorizer
Configuring the LDAP Authorizer
Configure LDAP Authentication
Data Protection
Audit Logs
Audit Log Concepts
Configuring Audit Logs using the CLI
Configure MDS to Manage Centralized Audit Logs
MDS API Audit Log Configuration
Configuring Audit Logs using the Properties File
Encryption with SSL
Secrets
Secrets Management
Tutorial: Secret Protection
Component Security
Confluent Control Center Security
Confluent Control Center Security
Configuring SSL
Control Center Configuring SASL
Control Center UI Authentication
Configuring Control Center to work with Kafka ACLs
Configuring Control Center with LDAP authentication
Configure RBAC for Control Center
Manage and view RBAC roles in Control Center
Log in to Control Center when RBAC enabled
Manage RBAC roles with Control Center
View your RBAC roles in Control Center
Streams Security
Schema Registry Security
Kafka Connect Security
Kafka Connect Security Basics
Kafka Connect and RBAC
Getting started with RBAC and Kafka Connect
Configuring RBAC for a Connect cluster
Configuring RBAC for a Connect worker
Configuring RBAC for connectors
Connect Secret Registry
Example role-binding sequence
ksqlDB RBAC
REST Proxy Security
REST Proxy Security
REST Proxy Security Plugins
ZooKeeper Security
Security Management Tools
Ansible Playbooks for Confluent Platform
Docker Security
Multi-DC Deployment Architectures
Overview
Replicator for Multi-Datacenter Replication
Replicator Overview
Tutorial: Replicating Data Between Clusters
Demo (Docker)
Download and Install
Configure and Run
Tuning Replicator
Monitoring Replicator
Replicator and Cross-Cluster Failover
Configuration Options
Migrate from MirrorMaker to Replicator
Replicator Verifier
Confluent Replicator to Confluent Cloud Configurations
Multi-Region Clusters
Overview
Tutorial: Multi-Region Clusters
Cluster Linking Preview
Cluster Linking
Demo (Docker)
Tutorial
Commands
Configuration Options
Metrics and Monitoring
Security
Administer
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Configuration Reference
Broker Configurations
Topic Configurations
Consumer Configurations
Producer Configurations
Connect Configurations
Overview
Sink Configuration Properties
Source Configuration Properties
AdminClient Configurations
License Configurations
Streams Configurations
Docker Configuration Parameters
Control Center Configurations
Streams Configurations
ZooKeeper Configurations
ksqlDB Server Configurations
CLI Tools for Confluent Platform
CLI Tools for Confluent Platform
Confluent CLI
Confluent Cloud CLI
Dynamic Configurations
Configure Multi-Node Environment
Confluent Metrics Reporter
Confluent Telemetry Reporter
Confluent REST APIs
Overview
Quick Start
API Reference
Production Deployment
Confluent Server
Configuration
Security
REST Proxy
Overview
Configuration
Monitoring
Security
Connect to Confluent Cloud
Changelog
REST Proxy Tutorial
Kafka Operations
Overview
Running Kafka in Production
Dynamic Configurations
Post Kafka Deployment
Self-Balancing Clusters
Self-Balancing Overview
Quick Start Demo (Docker)
Tutorial: Adding and Removing Brokers
Configuration Options and Commands
Performance and Resource Usage
Auto Data Balancing
Quick Start
Tutorial (Docker)
Configuration Options for the rebalancer tool
Monitoring Kafka
Confluent Metrics Reporter
kafkacat Utility
Tiered Storage
Docker Operations
Overview
Kafka Monitoring and Metrics Using JMX
Configure Docker Logging
Mounting Docker External Volumes
Post Kafka Deployment
ZooKeeper Operations
Overview
Running ZooKeeper in Production
Kafka Streams Operations
Capacity planning and sizing
Monitoring Kafka Streams Applications
ksqlDB Operations
DevOps for Apache Kafka® with Kubernetes and GitOps
Overview
Kafka DevOps Case Studies
Case Study: Graduated Environments
Case Study: Manage Cloud Secrets
Case Study: Kafka Connect management with GitOps
Monitor and Manage
Monitor and Manage Confluent Platform
Proactive Support
Confluent Telemetry Reporter
Confluent Metrics Reporter
Monitor Kafka
Confluent Control Center
Control Center Overview
Installing and configuring Control Center
Configuring Control Center
Control Center Configuration Reference
Auto-updating the Control Center user interface
Control Center Usage Data Collection
Control Center properties files
Connecting Control Center to Confluent Cloud
Confluent Monitoring Interceptors
Installing Control Center on Kafka
Managing Confluent Platform Licenses
Troubleshooting Control Center
Upgrading Control Center
Control Center User Guide
User Guide Overview
Clusters
Brokers
Topics
Topics Overview
Add topics
View topic metrics
Message Browser
Manage Schemas for Topics
Edit the configuration settings for topics
Delete a topic
Connect
ksqlDB
Consumers
Replicators
Cluster settings
Alerts
Concepts
Configure alerts properties
Configure PagerDuty email integration with Control Center alerts
Alerts navigation
Trigger management
Actions management
Example triggers and actions
REST API for alerts history
Troubleshooting alerts
System Health (deprecated view)
Data streams monitoring (deprecated view)
Confluent Control Center Security
Changelog
Control Center Changelog
Auto-Updating User Interface Changelog
Configure Docker Logging
Monitor Streams Applications
Resources
Release Notes
6.1.0 Release Notes
Component Changelogs
API and Javadocs
Streams Javadocs
Connect Javadocs
Connect REST Interface
Schema Registry API Reference
ksqlDB syntax reference
Confluent REST Proxy API Reference
Confluent Metadata API Reference
Confluent REST Proxy Changelog
¶
Version 5.4.0
¶
PR-546
- CPKAFKA-2590: Bump ZK connection timeout to avoid test flakes
PR-580
- MINOR: Include
zkclient
dependency to kafka-rest-scala-consumer shaded jar
PR-587
- Add API to get beginning offset, end offset and offset for time
PR-601
- CLIENTS-1454: Propagate Schema Registry properties to KafkaAvroDecoder
Version 5.1.0
¶
PR-511
- CPKAFKA-1876: Log cause of failure to produce messages in tests
PR-512
- Fix race condition when expiration thread iterates over partially-initialized consumer
PR-503
- Fix location of jars for dev testing
PR-481
- CPKAFKA-1681: Add long polling functionality
PR-508
- CPKAFKA-1868: Add more consumer tests
PR-507
- CPKAFKA-1871: Fix problem where ReadTaskSchedulerThread would loop too often
PR-504
- CPKAFKA-1865: Performance degrades drastically after running for extended periods
PR-495
- CPKAFKA-1794: Assign leader ID -1 on offline partitions in the topic describe API
PR-477
- Fix SimpleConsumerManager properly return requested offsets for compressed topic
PR-474
- MINOR: Fix checkstyle path
PR-466
- Change Consumer threading model to better handle rebalances
PR-459
- MINOR: Add utility createConsumerProperties() test method since it was removed from AK
PR-452
- Fix checkstyle to pass on 8.5 after upgrade from 6.19
PR-439
- Temporarily pin Kafka and Confluent versions
PR-438
- Don’t use deprecated RecordMetadata constructor
Version 5.0.0
¶
PR-439
- Temporarily pin Kafka and Confluent versions
PR-438
- Don’t use deprecated RecordMetadata constructor
PR-434
- Fix usage of internal Jersey utilities that no longer exist
PR-428
- Use ExplicitGCInvokesConcurrent instead of disabling explicit GC
Version 3.3.0
¶
PR-305
- Use max.block.ms instead of metadata.fetch.timeout.ms since the latter was deprecated and now removed in KAFKA-3763
Ability to add resources like filter through a custom extension and provide a custom context
PR-296
- Interceptor configuration options
Version 3.2.2
¶
PR-303
- CLIENTS-304: Fix AvroConsumerRecord constructors and handling of topic for v1 consumer API.
Version 3.2.1
¶
PR-285
- CLIENTS-281: Fix KafkaConsumerReadTask’s locking, handling of multiple polls, invalid handling of old ConsumerTimeout exceptions, and incorrect generic type parameters.
PR-277
- Documentation fixes
Version 3.2.0
¶
PR-256
- Update ClusterTestHarness to use o.a.k.common.utils.Time.
PR-255
- clarified the key/value format limitations based on user questions
PR-264
- Fix build to work post KIP-103
PR-265
- Follow up for KIP-103 changes that fixes ProducerPool’s extraction of endpoints to use the security protocol in the URL instead of the listener name.
PR-268
- modified readme to use v2. also bumped installation up for usability
PR-271
- Updated quickstart and configuration docs for V2 and for security
PR-258
- REST Proxy security
PR-274
- added field ‘topic’ to tools/ConsumerPerformance.java for system test
PR-272
- added description of JVM parameters for SASL configuration
Version 3.1.2
¶
No changes
Version 3.1.1
¶
No changes
Version 3.1.0
¶
PR-239
- Require bash since we use some bashisms and fix a copyright.
PR-235
- fix typo command line options
-help
check
PR-222
- fixing issue #91
PR-230
- Issue #229: Add blurb on Jetty jmx metrics
PR-214
- Small readme.md fix
PR-127
- Fix to ConsumerManager tests AND then handling of max bytes
PR-203
- Fix a typo that cause non-corresponding logger name
PR-202
- fix the implementation of topicExists
Version 3.0.0
¶
PR-164
- 2.x merge to master
PR-166
- Bump version to 3.0.0-SNAPSHOT and Kafka dependency to 0.10.0.0-SNAPSHOT
PR-171
- Fix build to handle rack aware changes in Kafka.
PR-174
- Update CoreUtils usage to match kafka updates
PR-189
- Minor fixes for compatibility with newest 0.10.0 branch.
PR-192
- Minor fixes for compatibility with newest 0.10.0 branch.
PR-202
- fix the implementation of topicExists
PR-205
- Rearrange quickstart and use topics from earlier steps in requests for metadata so the example output will exactly match real output when starting from an empty cluster.
Version 2.0.1
¶
PR-144
- Fix for Race condition when consuming while topic is being created (Issue #105)
PR-158
- Update Kafka version to 0.9.0.1-cp1
Version 2.0.0
¶
PR-64
- Reduce integration test time.
PR-66
- Add support for SimpleConsumer-like access (Issue #26)
PR-67
- Handle conflicting IDs and separate IDs used in the REST Proxy and by Kafka’s consumer implementation.
PR-78
- Remove kafka from list of production directories to include in CLASSPATH.
PR-89
- JSON message support
PR-96
- Fixed log4j and daemon flag bugs in kafka-rest-run-class based on fix from schema-registry.
PR-99
- Require Java 7
PR-101
- rest-utils updates
PR-103
- Issue 94 rename main
PR-108
- Clarify partitioning behavior for produce requests
PR-117
- Update to Kafka 0.9.0.0-SNAPSHOT and make adjustments to work with updated ZkUtils.
PR-122
- Use x.y.z versioning scheme (i.e. 2.0.0-SNAPSHOT)
PR-123
- Updated args for JaasUtils.isZkSecurityEnabled()
PR-125
- Use Kafka compiled with Scala 2.11
On this page: