If you encountered any issues while going through the quickstart workflow, review the following resolutions before trying the steps again.
Issue: Cannot locate the Datagen connector
For details, see Step 1: Download and Start Confluent Platform Using Docker.
Resolution: Run the build
command just for connect if the connect container was not built successfully.
docker-compose build --no-cache connect
Your output should resemble:
Building connect
...
Completed
Removing intermediate container cdb0af3550c8
---> 36d00047d29b
Successfully built 36d00047d29b
Successfully tagged confluentinc/kafka-connect-datagen:latest
If the connect container was already built successfully, you will see an output similar to this:
connect uses an image, skipping
Resolution: Check the Connect log for Datagen
.
docker-compose logs connect | grep -i Datagen
Your output should resemble:
connect | [2019-04-17 20:03:26,137] INFO Loading plugin from: /usr/share/confluent-hub-components/confluentinc-kafka-connect-datagen (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
connect | [2019-04-17 20:03:26,206] INFO Registered loader: PluginClassLoader{pluginLocation=file:/usr/share/confluent-hub-components/confluentinc-kafka-connect-datagen/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
connect | [2019-04-17 20:03:26,206] INFO Added plugin 'io.confluent.kafka.connect.datagen.DatagenConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
connect | [2019-04-17 20:03:28,102] INFO Added aliases 'DatagenConnector' and 'Datagen' to plugin 'io.confluent.kafka.connect.datagen.DatagenConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)
Resolution: Check the Connect log for a warning and reminder to run the docker-compose up -d
command properly.
docker-compose logs connect | grep -i Datagen
Resolution: Verify the .jar
file for kafka-connect-datagen
has been added and is present in the lib
subfolder.
docker-compose exec connect ls /usr/share/confluent-hub-components/confluentinc-kafka-connect-datagen/lib/
Your output should resemble:
...
kafka-connect-datagen-0.1.0.jar
...
Resolution: Verify the plugin exists in the connector path.
docker-compose exec connect bash -c 'echo $CONNECT_PLUGIN_PATH'
Your output should resemble:
/usr/share/java,/usr/share/confluent-hub-components
Confirm its contents are present:
docker-compose exec connect ls /usr/share/confluent-hub-components/confluentinc-kafka-connect-datagen
Your output should resemble:
assets doc etc lib manifest.json
Issue: Stream-Stream joins error
An error states Stream-Stream joins must have a WITHIN
clause specified. This error can occur if you created both pageviews
and users
as streams by mistake.
Resolution: Ensure that you created a stream for pageviews
, and a table for users
in Step 4: Create and Write to a Stream and Table using ksqlDB.
Issue: Unable to successfully complete ksqlDB query steps
Java errors or other severe errors were encountered.
Resolution: Ensure you are on an Operating System currently supported by Confluent Platform.
Resolution: Ensure that the Docker memory was increased to 8 MB. Go to Docker > Preferences > Advanced. If Docker memory is insufficient, other unpredictable issues could occur.
Issue: Demo times out, some or all components do not start
You must allocate a minimum of 8 GB of Docker memory resource. The default
memory allocation on Docker Desktop for Mac is 2 GB and must be changed. Confluent Platform
demos and examples running on Docker may fail to work properly if Docker memory
allocation does not meet this minimum requirement.