[FLINK-28376] Restrict the number of threads for sort-shuffle data read

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.16.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Yuxin Tan
• Reporter: Yingjie Cao
• Created: 04/Jul/22 08:31
• Updated: 21/Jul/22 03:26
• Resolved: 21/Jul/22 03:26

Description

Currently, the number of IO threads for shuffle data reading is relevant to the size of reading memory and the number of CPU cores. We should also consider the number of slots and the number of disks.

Issue Links

• links to: GitHub Pull Request #20308