Get Confluent | Sign up for
Confluent Cloud
or download
Confluent Platform
Home
Platform
Cloud
Connectors
Tools
Clients
Download Confluent
Back to home
JDBC SOURCE AND SINK
JDBC Source Connector for Confluent Platform
Overview
JDBC Connector Source Connector Configuration Properties
JDBC Sink Connector for Confluent Platform
Overview
JDBC Sink Connector Configuration Properties
Changelog
Changelog
¶
Version 10.0.0
¶
PR-928
- CC-3610: Add Oracle and SQL Server JDBC drivers, which are now distribution friendly
PR-918
- CC-8794: MS SQL Server datetime give repeated messages due to rounding error
PR-925
- CC-11940: fix a bug that happens when merging long text to oracle table
PR-924
- MINOR: Fix exception when failing to read tables
PR-930
- CC-11984: Remove the
table.whitelist
and
table.blacklist
recommended values
PR-847
- Allow ‘connection.attempts’ and ‘connection.backoff.ms’ to be configured for sink connectors
PR-887
- Add the possibility for dialects to provide a SQL type for null values
PR-910
- CC-11507: Always parse Date in UTC
PR-692
- Enable CURRENT_TIMESTAMP for SAP HANA JDBC
PR-888
- CC-10823: Require non-tombstone records when deletes are disabled
PR-884
- SEC-1034: log4j migration to confluent repackaged version
PR-875
- CC-9565: Add support for casting stringified UUIDs to
uuid
upon insert/update/upsert in PostgreSQL
PR-870
- CC-9567: Allow users to define extra connection properties individually rather than only through JDBC URI
PR-866
- CC-8750: Changed the dialects to sanitize all URL properties that case-insensitively contain “password”
PR-477
- Add support for uuid columns
PR-844
- CC-8898: Add better error messages when consumed records don’t match connector config
PR-828
- MINOR: Retain chain of SQLException exceptions
PR-839
- CC-8823: Add support for the JDBC sink to write to views in addition to tables
PR-804
- #363 - MySQL Sink create string columns as TEXT instead of VARCHAR(256)
Version 5.5.2
¶
PR-910
- CC-11507: Always parse Date in UTC
PR-906
- SEC-1307: Backport “log4j replacement with confluent repackaged version”
PR-692
- Enable CURRENT_TIMESTAMP for SAP HANA JDBC
Version 5.5.1
¶
PR-866
- CC-8750: Changed the dialects to sanitize all URL properties that case-insensitively contain “password”
PR-844
- CC-8898: Add better error messages when consumed records don’t match connector config
PR-828
- MINOR: Retain chain of SQLException exceptions
PR-839
- CC-8823: Add support for the JDBC sink to write to views in addition to tables
Version 5.5.0
¶
JDBC Source Connector
¶
PR-797
- MINOR: Upgrade to Derby 10.14.2.0.
PR-794
- CC-6411: Upgrade JDBC driver for Postgres to 42.2.10.
PR-793
- CC-7637: added logging of query at TRACE level.
PR-792
- CC-8090: Validate connection.attempts property in config class.
PR-791
- CC-8087: Remove plaintext logging of task configs.
PR-429
- Added
timestamp.initial
config, used for initial queries that use timestamp criteria.
PR-715
- Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed.
PR-770
- CC-7628: Set conservative connection timeout for JDBC driver.
PR-775
- Move setFetchSize to GenericDatabaseDialect.
PR-730
- Add suffix to append at the end of the generated query.
PR-758
- Fix Postgres OOM by limiting fetch size.
JDBC Sink Connector
¶
PR-794
- CC-6411: Upgrade jdbc driver for postgres to 42.2.10.
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628: Set conservative connection timeout for JDBC driver.
PR-748
- Handling deletes correctly with non-null value schema and null records.
Version 5.4.3
¶
PR-918
- CC-8794: MS SQL Server datetime give repeated messages due to rounding error
PR-925
- CC-11940: fix a bug that happens when merging long text to oracle table
PR-924
- MINOR: Fix exception when failing to read tables
PR-910
- CC-11507: Always parse Date in UTC
PR-906
- SEC-1307: Backport “log4j replacement with confluent repackaged version”
PR-692
- Enable CURRENT_TIMESTAMP for SAP HANA JDBC
PR-866
- CC-8750: Changed the dialects to sanitize all URL properties that case-insensitively contain “password”
PR-844
- CC-8898: Add better error messages when consumed records don’t match connector config
PR-828
- MINOR: Retain chain of SQLException exceptions
Version 5.4.2
¶
PR-839
- CC-8823: Add support for the JDBC sink to write to views in addition to tables
PR-830
- CC-8651: Backport docs copy-edits to config docstrings.
Version 5.4.1
¶
PR-799
- MINOR: Upgrade Postgres driver from 9.4.1212 to 42.2.10
PR-797
- MINOR: Upgrade to Derby 10.14.2.0
PR-793
- CC-7637: Change Statement logging from DEBUG level to TRACE level in TimestampIncrementingTableQuerier
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-791
- CC-8087: Remove plaintext logging of task configs
PR-715
- [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
PR-775
- Move setFetchSize to GenericDatabaseDialect
PR-748
- Handle deletes with schema non-null
PR-758
- Fix Postgres OOM by limiting fetch size
PR-739
- MINOR: Add TimeZoneValidator::toString.
Version 5.4.0
¶
JDBC Source Connector
¶
PR-761
- CC-7414: Fix SqlServer column converter infinite loop & add column converter tests
PR-757
- CC-7332: Changed one log message from INFO to DEBUG to reduce verbocity
PR-750
- CC-7265: Support SQL Server DateTimeOffset
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-727
- CC-6773: Abort source task if all columns were not converted correctly.
PR-724
- CC-6747: Replace static mocking for the CachedConnectionProvider
PR-677
- Fix
ERROR Graceful stop of task failed
PR-686
- MINOR: Upgrade PostgreSQL jdbc driver to most recent bugfix release (9.4.1212)
PR-655
- CC-4946: changing log msgs on filtering and avoiding frequently retrying tasks when no tables exist
PR-672
- Change TableQuerier log to use real class name for file
JDBC Sink Connector
¶
PR-759
- CC-7382: use true/false as default values for boolean type
PR-728
- MINOR: Expose SinkRecordField schema to database dialects
PR-706
- MINOR: Avoid NPE when columns cannot be described
PR-686
- MINOR: Upgrade PostgreSQL jdbc driver to most recent bugfix release (9.4.1212)
PR-673
- SqlServerDialect uses varchar(900) for primary key as string type
PR-605
- Fix PostgreSqlDatabaseDialect to generate proper UPSERT queries when no non-key columns are present
Version 5.3.4
¶
PR-910
- CC-11507: Always parse Date in UTC
PR-692
- Enable CURRENT_TIMESTAMP for SAP HANA JDBC
PR-866
- CC-8750: Changed the dialects to sanitize all URL properties that case-insensitively contain “password”
PR-828
- MINOR: Retain chain of SQLException exceptions
PR-830
- CC-8651: Backport docs copy-edits to config docstrings.
Version 5.3.3
¶
PR-799
- MINOR: Upgrade Postgres driver from 9.4.1212 to 42.2.10
PR-797
- MINOR: Upgrade to Derby 10.14.2.0
PR-793
- CC-7637: Change Statement logging from DEBUG level to TRACE level in TimestampIncrementingTableQuerier
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-791
- CC-8087: Remove plaintext logging of task configs
PR-715
- [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
PR-775
- Move setFetchSize to GenericDatabaseDialect
PR-748
- * Handling deletes with schema !null
PR-758
- Fix Postgres OOM by limiting fetch size
PR-739
- MINOR: Add TimeZoneValidator::toString.
Version 5.3.2
¶
PR-761
- CC-7414: Fix SqlServer column converter infinite loop & add column converter tests
PR-757
- CC-7332: Changed one log message from INFO to DEBUG to reduce verbocity
PR-750
- CC-7265: Support SQL Server DateTimeOffset
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-728
- MINOR: Expose SinkRecordField schema to database dialects
PR-724
- CC-6747: Replace static mocking for the CachedConnectionProvider
PR-706
- MINOR: Avoid NPE when columns cannot be described
Version 5.3.1
¶
No changes
Version 5.3.0
¶
JDBC Source Connector
¶
PR-642
- CC-4423 Remove semicolon from Db2 dialect timestamp query.
PR-628
- Use Java 7 to validate timezones.
JDBC Sink Connector
¶
PR-663
- MINOR: Remove the final keyword from JdbcSinkConnector.
PR-641
- CC-349: Add delete support for sink.
PR-642
- CC-4423 Remove semicolon from Db2 dialect timestamp query.
PR-628
- Use Java 7 to validate timezones.
Version 5.2.4
¶
PR-799
- MINOR: Upgrade Postgres driver from 9.4.1212 to 42.2.10
PR-797
- MINOR: Upgrade to Derby 10.14.2.0
PR-793
- CC-7637: Change Statement logging from DEBUG level to TRACE level in TimestampIncrementingTableQuerier
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-791
- CC-8087: Remove plaintext logging of task configs
PR-715
- [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
PR-775
- Move setFetchSize to GenericDatabaseDialect
PR-758
- Fix Postgres OOM by limiting fetch size
PR-739
- MINOR: Add TimeZoneValidator::toString.
PR-761
- CC-7414: Fix SqlServer column converter infinite loop & add column converter tests
PR-750
- CC-7265: Support SQL Server DateTimeOffset
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-728
- MINOR: Expose SinkRecordField schema to database dialects
PR-724
- CC-6747: Replace static mocking for the CachedConnectionProvider
PR-706
- MINOR: Avoid NPE when columns cannot be described
Version 5.2.3
¶
PR-663
- MINOR: Remove the final keyword from JdbcSinkConnector
Version 5.2.2
¶
PR-642
- CC-4423 Remove semicolon from Db2 dialect timestamp query
PR-628
- Use Java 7 to valiate timezones
Version 5.2.1
¶
No changes
Version 5.2.0
¶
JDBC Source Connector
¶
PR-612
- CC-3812: Sqlite timestamp parse error
PR-529
- Update the SQL Server dialect to properly retrieve auto incremented column information.
PR-519
- Fix UPDATE WHERE with multiple keyColumns
PR-505
- Added db.timezone setting
JDBC Sink Connector
¶
PR-612
- CC-3812: Sqlite timestamp parse error
PR-529
- Update the SQL Server dialect to properly retrieve auto incremented column information.
PR-519
- Fix UPDATE WHERE with multiple keyColumns
PR-505
- Added db.timezone setting
Version 5.1.4
¶
PR-799
- MINOR: Upgrade Postgres driver from 9.4.1212 to 42.2.10
PR-797
- MINOR: Upgrade to Derby 10.14.2.0
PR-796
- MINOR: Upgrade to Derby 10.12.1.1 on versions prior to CP 5.0.x
PR-793
- CC-7637: Change Statement logging from DEBUG level to TRACE level in TimestampIncrementingTableQuerier
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-791
- CC-8087: Remove plaintext logging of task configs
PR-715
- [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
PR-775
- Move setFetchSize to GenericDatabaseDialect
PR-758
- Fix Postgres OOM by limiting fetch size
PR-739
- MINOR: Add TimeZoneValidator::toString.
PR-761
- CC-7414: Fix SqlServer column converter infinite loop & add column converter tests
PR-750
- CC-7265: Support SQL Server DateTimeOffset
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-728
- MINOR: Expose SinkRecordField schema to database dialects
PR-724
- CC-6747: Replace static mocking for the CachedConnectionProvider
PR-706
- MINOR: Avoid NPE when columns cannot be described
PR-663
- MINOR: Remove the final keyword from JdbcSinkConnector
Version 5.1.3
¶
PR-642
- CC-4423 Remove semicolon from Db2 dialect timestamp query
PR-628
- Use Java 7 to valiate timezones
PR-621
- Backport db.timzeone config
PR-612
- CC-3812: Sqlite timestamp parse error
Version 5.1.2
¶
No changes
Version 5.1.1
¶
No changes
Version 5.1.0
¶
JDBC Source Connector
¶
PR-535
- CC-3414: Changed PostgreSQL dialect to use BYTEA rather than BLOB
PR-459
- Fix checkstyle to pass on 8.5 after upgrade from 6.19
JDBC Sink Connector
¶
PR-535
- CC-3414: Changed PostgreSQL dialect to use BYTEA rather than BLOB
PR-527
- MINOR Add log statements to debug different flush paths
PR-530
- CC-3069: Corrected DB2 and Derby upsert statements
Version 5.0.4
¶
PR-828
- MINOR: Retain chain of SQLException exceptions
PR-830
- CC-8651: Backport docs copy-edits to config docstrings.
PR-799
- MINOR: Upgrade Postgres driver from 9.4.1212 to 42.2.10
PR-797
- MINOR: Upgrade to Derby 10.14.2.0
PR-796
- MINOR: Upgrade to Derby 10.12.1.1 on versions prior to CP 5.0.x
PR-793
- CC-7637: Change Statement logging from DEBUG level to TRACE level in TimestampIncrementingTableQuerier
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-791
- CC-8087: Remove plaintext logging of task configs
PR-715
- [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
PR-787
- Make metadata allFields ordered consistently with the valueSchema.
PR-770
- CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
PR-775
- Move setFetchSize to GenericDatabaseDialect
PR-758
- Fix Postgres OOM by limiting fetch size
PR-739
- MINOR: Add TimeZoneValidator::toString.
PR-761
- CC-7414: Fix SqlServer column converter infinite loop & add column converter tests
PR-750
- CC-7265: Support SQL Server DateTimeOffset
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-728
- MINOR: Expose SinkRecordField schema to database dialects
PR-724
- CC-6747: Replace static mocking for the CachedConnectionProvider
PR-706
- MINOR: Avoid NPE when columns cannot be described
PR-663
- MINOR: Remove the final keyword from JdbcSinkConnector
PR-642
- CC-4423 Remove semicolon from Db2 dialect timestamp query
PR-628
- Use Java 7 to valiate timezones
Version 5.0.3
¶
PR-621
- Backport db.timzeone config
PR-612
- CC-3812: Sqlite timestamp parse error
Version 5.0.2
¶
PR-527
- MINOR Add log statements to debug different flush paths
Version 5.0.1
¶
No changes
Version 5.0.0
¶
JDBC Source Connector
¶
PR-438
- Fail if the filtered tables list has duplicates based on unqualified table name
PR-436
- CC-2116: Fix offsets compatibility
PR-431
- CC-2220: Parse to get the actual table name to avoid double prefixing
PR-428
- CC-2139: Moved the call to set the fetch direction out of generic dialect
PR-333
- CC-1193: Refactored with a new dialect framework for DBMS-specific behavior
PR-416
- CC-2043: Update pom.xml to target Java 8
JDBC Sink Connector
¶
PR-431
- CC-2220: Parse to get the actual table name to avoid double prefixing
PR-428
- CC-2139: Moved the call to set the fetch direction out of generic dialect
PR-333
- CC-1193: Refactored with a new dialect framework for DBMS-specific behavior
PR-416
- CC-2043: Update pom.xml to target Java 8
Version 4.1.4
¶
PR-800
- MINOR: Upgrade Postgres driver from 9.4-1206-jdbc41 to 42.2.10.jre7
PR-796
- MINOR: Upgrade to Derby 10.12.1.1 on versions prior to CP 5.0.x
PR-792
- CC-8090: Validate connection.attempts property in config class
PR-752
- CC-7265: Add support for SQL Server DateTimeOffset type
PR-628
- Use Java 7 to valiate timezones
PR-622
- Backport db.timzeone config to 4.1.x
Version 4.1.3
¶
No changes
Version 4.1.2
¶
No changes
Version 4.1.1
¶
No changes
JDBC Source Connector
¶
PR-392
- CC-918 Add Kafka Connect Maven plugin to build
PR-396
- CC-1843: Add config option for extended handling of numeric data type
JDBC Sink Connector
¶
PR-392
- CC-918 Add Kafka Connect Maven plugin to build
PR-399
- CC-1852: Be less restrictive in JDBC URL validation
PR-400
- CC-1878: Allow for case differences while finding missing columns
Version 4.1.0
¶
JDBC Source Connector
¶
PR-351
- CC-1366: close ResultSets and Statements during shutdown
PR-331
- add a note about SSL with JDBC
PR-319
- get current timestamp on all DB2 versions - reopening from k1th/master
JDBC Sink Connector
¶
PR-331
- add a note about SSL with JDBC
PR-306
- Log out actual sql exceptions (fix for #291)
Version 4.0.3
¶
No changes
Version 4.0.2
¶
PR-400
- CC-1878: Allow for case differences while finding missing columns
Version 4.0.1
¶
JDBC Source Connector
¶
PR-331
- add a note about SSL with JDBC
PR-319
- get current timestamp on all DB2 versions - reopening from k1th/master
JDBC Sink Connector
¶
PR-319
- get current timestamp on all DB2 versions - reopening from k1th/master
Version 4.0.0
¶
JDBC Source Connector
¶
PR-295
- Remove unused imports
PR-288
- Remove unnecessary surefire configuration overrides.
PR-287
- CC-1112: Use common pom as parent and fix checkstyle issues.
PR-212
- Fixed issue #211 - get current timestamp on DB2 UDB for AS/400
PR-203
- Issue #198: Improved the JdbcSourceConnector to retry JDBC connection when needed on startup
JDBC Sink Connector
¶
PR-295
- Remove unused imports
PR-288
- Remove unnecessary surefire configuration overrides.
PR-287
- CC-1112: Use common pom as parent and fix checkstyle issues.
PR-212
- Fixed issue #211 - get current timestamp on DB2 UDB for AS/400
PR-250
- Fix typo (dd -> add)
Version 3.3.3
¶
No changes
Version 3.3.2
¶
PR-400
- CC-1878: Allow for case differences while finding missing columns
Version 3.3.1
¶
JDBC Source Connector
¶
PR-293
- Fix source connector start/stop test
PR-285
- Add upstream project so build are triggered automatically
PR-273
- CC-1065 Source connector’s recommender uses table type filter and caches results
PR-272
- CC-1064 Corrected the table name recommender to always close the JDBC connection
JDBC Sink Connector
¶
No changes
Version 3.3.0
¶
JDBC Source Connector
¶
No changes
JDBC Sink Connector
¶
PR-188
- Add rpm build to lifecycle.
PR-195
- Statement.SUCCESS_NO_INFO should be treated in BufferedRecords.flush.
PR-202
- HP Vertica dialect.
PR-205
- JDBC Sink Connector - Add insert.mode = UPDATE, that generates only update queries.
Version 3.2.4
¶
No changes
Version 3.2.3
¶
No changes
Version 3.2.2
¶
No changes
Version 3.2.1
¶
No changes
Version 3.2.0
¶
JDBC Source Connector
¶
PR-156
- CC-348: Separate username & password config for JDBC source connector
PR-155
- Switch RST generation to ConfigDef.toEnrichedRst() available against 0.10.2
PR-154
- Re-check stop flag before continuing after sleep
PR-167
- Connection.isValid() expects seconds not milliseconds
PR-175
- Use UTC Calendar when binding date/times in sink; fix thread-unsafe usage of UTC_CALENDAR in TimestampIncrementingTableQuerier
PR-169
- Widen schema types for unsigned numeric types.
JDBC Sink Connector
¶
PR-168
- Change default MySQL Schema.Type.TIMESTAMP mapping from TIMESTAMP to DATETIME
PR-171
- CC-432: Missing PreparedStatement.close()
PR-180
- SqlServerDialect’s upsert query placeholders should be in the order keyCols*, cols*
Version 3.1.2
¶
No changes
Version 3.1.1
¶
No changes
Version 3.1.0
¶
JDBC Source Connector
¶
PR-148
- Update licenses, tweaking some dependency scopes, files to include in packaging, and ensuring the create-licenses scope can run cleanly without extra manual steps.
PR-144
- CC-263: Prevent retrying queries with a broken connection
PR-140
- CC-331: Config option doc updates
PR-129
- CC-311: support for Decimal logical type as incrementing column
PR-128
- Fix short version in conf.py
PR-109
- Ability to set the schema pattern for tables metadata retrieval
PR-122
- supporting tinyint for primary key
PR-110
- Added link to Confluent documentation for the connector.
PR-49
- CC-69: support nanoseconds precision for timestamp-based offset tracking
PR-96
- CC-243: use Long for nanos in offset map rather than Integer
PR-93
- Fix thread-safety of date/time conversions in DataConverter
PR-87
- Clean up table types documentation config and include it in a group with display attributes.
PR-37
- Exposed Table Types as a config
PR-85
- Add table.blacklist display name
JDBC Sink Connector
¶
New in 3.1.0
Version 3.0.1
¶
JDBC Source Connector
¶
PR-88
- Close all ResultSets in JdbcUtils
PR-94
- add version.txt to share/doc
Version 3.0.0
¶
JDBC Source Connector
¶
PR-73
- Update doc for Confluent Platform 3.0.
PR-66
- Task config should not show up in connector config.
PR-59
- Add schema evolution in doc.
PR-55
- Use new config definition.
PR-53
- Adding checkstyle checks and the traditional minor fixes related.
PR-51
- Add config to disable non-null checks.
PR-50
- Bump version to 3.0.0-SNAPSHOT and Apache Kafka® dependency to 0.10.0.0-SNAPSHOT.
PR-48
- Delayed copy.
PR-45
- Added some logging.
On this page: