[KAFKA-15022] Support rack aware task assignment in Kafka streams

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.6.0, 3.7.0
• Component/s: streams
• Labels: kip kip-925
• Assignee: Hao Li
• Reporter: Hao Li
• Created: 25/May/23 18:19
• Updated: 07/Dec/23 21:15
• Resolved: 06/Dec/23 16:15

Description

For KIP-925: https://cwiki.apache.org/confluence/display/KAFKA/KIP-925%3A+Rack+aware+task+assignment+in+Kafka+Streams

Issue Links

• links to: GitHub Pull Request #13846
• links to: GitHub Pull Request #13851
• links to: GitHub Pull Request #13996
• links to: GitHub Pull Request #14030
• links to: GitHub Pull Request #14097
• links to: GitHub Pull Request #14108
• links to: GitHub Pull Request #14139
• links to: GitHub Pull Request #14150
• links to: GitHub Pull Request #14164
• links to: GitHub Pull Request #14178
• links to: GitHub Pull Request #14181
• links to: GitHub Pull Request #14198
• links to: GitHub Pull Request #14696
• links to: GitHub Pull Request #14711
• links to: GitHub Pull Request #14714
• links to: GitHub Pull Request #14921
• mentioned in: Page Loading...

Sub-Tasks

• Get rack information for source topic partitions for a task: Closed
• Add cost function for task/client: Closed
• Implement min-cost flow without balancing tasks for same subtopology: Closed
• Implement min-cost flow balancing tasks for same subtopology: Closed
• Implement rack aware assignment for standby tasks: Closed
• Add configs and logic to decide if rack aware assignment should be enabled: Closed