Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14253

StreamsPartitionAssignor should print the member count in assignment logs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.5.0
    • streams

    Description

      Debugging rebalance and assignment issues is harder than it needs to be. One simple thing that can help is to print out information in the logs that users have to compute today.

      For example, the StreamsPartitionAssignor prints two messages that contain the the newline-delimited group membership:

      [StreamsPartitionAssignor] [...-StreamThread-1] stream-thread [...-StreamThread-1-consumer] All members participating in this rebalance:
      
      <member UUID>: [<consumer ID>]
      
      <member UUID>: [<consumer ID>]
      
      <member UUID>: [<consumer ID>]

      and

      [StreamsPartitionAssignor] [...-StreamThread-1] stream-thread [...-StreamThread-1-consumer] Assigned tasks [...] including stateful [...] to clients as:
      
      <member UUID>=[activeTasks: ([...]) standbyTasks: ([...])]
      
      <member UUID>=[activeTasks: ([...]) standbyTasks: ([...])]
      
      <member UUID>=[activeTasks: ([...]) standbyTasks: ([...])
      

       

      In both of these cases, it would be nice to:

      1. Include the number of members in the group (I.e., "15 members participating" and "to 15 clients as")
      2. sort the member ids (to help compare the membership and assignment across rebalances)

      Attachments

        Issue Links

          Activity

            People

              pooya72 Christopher Pooya Razavian
              vvcephei John Roesler
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: