Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6583

Metadata should include number of state stores for task

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 0.10.2.0, 0.11.0.0
    • None
    • streams

    Description

      Currently, in the need for clients to be more evenly balanced, stateful tasks should be distributed in such a manner that it will be spread equally. However, for such an awareness to be implemented during task assignment, it would require the need for the present rebalance protocol metadata to also contain the number of state stores in a particular task. This way, it will allow us to "weight" tasks during assignment. 

      Attachments

        Issue Links

          blocks

          Sub-task - The sub-task of the issue KAFKA-4696 Streams standby task assignment should be state-store aware

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue KAFKA-4969 State-store workload-aware StreamsPartitionAssignor

          • Major - Major loss of function.
          • Resolved
          Is contained by

          Sub-task - The sub-task of the issue KAFKA-4696 Streams standby task assignment should be state-store aware

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Yohan123 Richard Yu
              Yohan123 Richard Yu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: