Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5087

Kafka Connect's configuration topics should always be compacted

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: KafkaConnect
    • Labels:
      None

      Description

      New users frequently lose their connector configuration because they did not manually set the topic deletion policy to "compact". Not a good first experience with our system.

      1. If the topics do not exist, Kafka Connect should create them with the correct configuration.
      2. If the topics do exist, Kafka Connect should check their deletion policy and refuse to start if it isn't "compact"

      I'd love to do it (or have someone else do it) the moment the AdminClient is merged and to have it in 0.11.0.0.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ewencp Ewen Cheslack-Postava
                Reporter:
                gwenshap Gwen Shapira
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: