[FLINK-30670] Ignore broadcast bytes when computing parallelism and input infos for adaptive batch scheduler

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: 1.17.0
• Component/s: Runtime / Coordination
• Assignee: Lijie Wang
• Reporter: Lijie Wang
• Created: 13/Jan/23 06:35
• Updated: 16/Jan/23 09:17
• Resolved: 16/Jan/23 09:17

Description

Currently, we include the broadcast bytes in the "jobmanager.adaptive-batch-scheduler.avg-data-volume-per-task" when calculating the parallelism (see PR17952 for details), and set a cap ratio(0.5) for the broadcast bytes. Considering that the broadcast bytes are generally relatively small, we can ignore the broadcast bytes to simplify the logic.

Issue Links

• links to: GitHub Pull Request #21646