Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6150

Make Repartition Topics Transient

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: streams
    • Labels:

      Description

      Unlike changelog topics, the repartition topics could just be short-lived. Today users have different ways to configure them with short retention such as enforce a short retention period or use AppendTime for repartition topics. All these would be cumbersome and Streams should just do this for the users.

      One way to do it is use the “purgeData” admin API (KIP-107) such that after the offset of the input topics are committed, if the input topics are actually repartition topics, we would purge the data immediately.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                guozhang Guozhang Wang
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: