[KAFKA-10368] Rack aware assignment results not balanced

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.11.0.0, 1.1.0, 1.1.1, 2.4.0
• Component/s: admin
• Assignee: Unassigned
• Reporter: hanmingze
• Created: 06/Aug/20 13:47
• Updated: 06/Aug/20 14:17

Description

When the number of broker in two rack is inconsistent, the assignment results is not balanced in the broker within a rack。

 

Example：

1000 topic, 10 partitions per topic, 2 replica prt partition

5 nodes, distributed in two rack(3+2)

 

broker.id=1  rack=idc-a

broker.id=2  rack=idc-a

broker.id=3  rack=idc-a

broker.id=4  rack=idc-b

broker.id=5  rack=idc-b

 

Assignment result:

broker.id  |  replica number

1  |  2000

2  |  4000

3  |  4000

4  |  5000

5  |  5000