Major Description
In StreamsPartitionAssignor, we do a two-level assignment, one on the client-level, and then after the assignment is done we further decide within the client how to distributed among consumers if there are more.
The ClientState class is used for book-keeping the assigned tasks, however it is only used for the first level, while for the second level it is done outside of the class and we only keep track of the results in a few maps for logging purposes. This leaves us with a bunch of hierarchical maps, e.g. some on the client level and some on the consumer level.
We would like to consolidate some of these maps into a single data structure for better keeping track of the assignment information, and also for less bug vulnerability causing the assignment information to be inconsistent.
Attachments
Issue Links
- links to