Description
As of 0.11.0.0, Kafka Connect will be able to automatically create its internal topics using the new AdminClient (see KAFKA-4667). However, it still relies upon the broker auto-creating topics to which source connector records are written.
Kafka Connect should use the AdminClient to explicitly create the new topics before writing the first source record to a new topic, and it should allow the connector the opportunity to customize the topic-specific settings for those new topics. As such, it will require a change in the public API (configs and/or framework) for source connectors and thus will require a KIP.
Attachments
Issue Links
- is related to
-
KAFKA-17808 InstanceAlreadyExistsException: kafka.admin.client:type=app-info,id=connector-dlq-adminclient- when add connector with tasks
-
- Open
-
- relates to
-
-
- Open
-
- links to