Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6761

Reduce Kafka Streams Footprint

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: streams
    • Labels:
      None

      Description

      The persistent storage footprint of a Kafka Streams application contains the following aspects:

      1. The internal topics created on the Kafka cluster side.
      2. The materialized state stores on the Kafka Streams application instances side.

      There have been some questions about reducing these footprints, especially since many of them are not necessary. For example, there are redundant internal topics, as well as unnecessary state stores that takes up space but also affect performance. When people are pushing Streams to production with high traffic, this issue would be more common and severe. Reducing the footprint of Streams have clear benefits for reducing resource utilization of Kafka Streams applications, and also not creating pressure on broker's capacities.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bbejeck Bill Bejeck
                Reporter:
                bbejeck Bill Bejeck
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: