[FLINK-26517] Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Lijie Wang
• Reporter: Lijie Wang
• Created: 07/Mar/22 09:32
• Updated: 10/Mar/22 02:22
• Resolved: 10/Mar/22 02:22

Description

As describe in FLINK-26330, in order to make the number of subpartitoins evenly consumed by downstream tasks, we need to normalize the decided parallelism to 2^N.

Issue Links

• fixes: FLINK-25011 Introduce VertexParallelismDecider
• relates to: FLINK-26330 Test Adaptive Batch Scheduler manually
• links to: GitHub Pull Request #19003