Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6583

Metadata should include number of state stores for task

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 0.10.2.0, 0.11.0.0
    • Fix Version/s: None
    • Component/s: streams
    • Labels:

      Description

      Currently, in the need for clients to be more evenly balanced, stateful tasks should be distributed in such a manner that it will be spread equally. However, for such an awareness to be implemented during task assignment, it would require the need for the present rebalance protocol metadata to also contain the number of state stores in a particular task. This way, it will allow us to "weight" tasks during assignment. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Yohan123 Richard Yu
                Reporter:
                Yohan123 Richard Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: