Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6150

Make Repartition Topics Transient

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: streams
    • Labels:

      Description

      Unlike changelog topics, the repartition topics could just be short-lived. Today users have different ways to configure them with short retention such as enforce a short retention period or use AppendTime for repartition topics. All these would be cumbersome and Streams should just do this for the users.

      One way to do it is use the “purgeData” admin API (KIP-107) such that after the offset of the input topics are committed, if the input topics are actually repartition topics, we would purge the data immediately.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              guozhang Guozhang Wang
              Reporter:
              guozhang Guozhang Wang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment