Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6729

KTable should use user source topics if possible and not create changelog topic

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 1.0.0
    • 2.0.0
    • streams
    • None

    Description

      With KIP-182 we reworked Streams API largely and introduced a regression into 1.0 code base. If a KTable is populated from a source topic, ie, StreamsBuilder.table() – the KTable does create its own changelog topic. However, in older releases (0.11 or older), we don't create a changelog topic but use the user specified source topic instead.

      We want to reintroduce this optimization to reduce the load (storage and write) on the broker side for this case.

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-7424 State stores restoring from changelog topic not the source topic

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #5017

          Web Link GitHub Pull Request #5038

          Activity

            People

              guozhang Guozhang Wang
              mjsax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: