[KAFKA-8465] Make sure that the copy of the same topic is evenly distributed across a broker's disk.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.1, 2.2.0, 2.2.1
• Component/s: core
• Flags: Patch
• Assignee: Unassigned
• Reporter: ChenLin
• Created: 02/Jun/19 12:40
• Updated: 01/Aug/19 15:19

Description

When some partiton's replication is assigned to a broker, which disks should these copies be placed on the broker? The original strategy is to allocate according to the number of partiitons。This strategy will result in uneven disk allocation for the topic dimension.
In order to solve this problem, we propose an improved strategy: first ensure that the number of partitions of each disk in the topic dimension is even. If the number of partitions of a topic on two disks is equal, then sort according to the total number of partitions on the disk. Select a disk with the least number of partitions to store the current replication.

 

Issue Links

• links to: GitHub Pull Request #6866
• links to: GitHub Pull Request #7133