Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5087

Kafka Connect's configuration topics should always be compacted

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • None
    • None
    • connect
    • None

    Description

      New users frequently lose their connector configuration because they did not manually set the topic deletion policy to "compact". Not a good first experience with our system.

      1. If the topics do not exist, Kafka Connect should create them with the correct configuration.
      2. If the topics do exist, Kafka Connect should check their deletion policy and refuse to start if it isn't "compact"

      I'd love to do it (or have someone else do it) the moment the AdminClient is merged and to have it in 0.11.0.0.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-4667 KIP-154: Connect should create internal topics

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-9216 Enforce connect internal topic configuration at startup

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ewencp Ewen Cheslack-Postava
              gwenshap Gwen Shapira
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: