Description
Recently Kafka community is promoting cooperative rebalancing to mitigate the pain points in the stop-the-world rebalancing protocol. This ticket is created to initiate that idea at the Kafka consumer client, which will be beneficial for heavy-stateful consumers such as Kafka Streams applications.
In short, the scope of this ticket includes reducing unnecessary rebalance latency due to heavy partition migration: i.e. partitions being revoked and re-assigned. This would make the built-in consumer assignors (range, round-robin etc) to be aware of previously assigned partitions and be sticky in best-effort.
Attachments
Issue Links
- relates to
-
KAFKA-8951 Avoid unnecessary rebalances and downtime for "safe" partitions
-
- Open
-
- links to
- mentioned in
-
Page Loading...