[FLINK-17248] Make the thread nums of io executor of ClusterEntrypoint and MiniCluster configurable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.2, 1.11.0
• Component/s: Runtime / Checkpointing, Runtime / Coordination
• Labels: pull-request-available
• Assignee: Yun Tang
• Reporter: Yun Tang
• Created: 19/Apr/20 18:08
• Updated: 16/Oct/20 10:32
• Resolved: 16/May/20 12:36

Description

FLINK-11851 introduce dedicated io executor for ClusterEntrypoint and MiniCluster with the the thread num as the cpu cores. However, this could introduce extra regression as we might use fewer threads compared with akka service before, e.g.FLINK-17073 . However, we cannot configure the thread num of the io executor to avoid such regression.

One idea is to introduce such configuration to make the thread nums of io executor of ClusterEntrypoint and MiniCluster configurable.

Issue Links

• is caused by: FLINK-11851 ClusterEntrypoint provides wrong executor to HaServices
• relates to: FLINK-17073 Slow checkpoint cleanup causing OOMs
• links to: GitHub Pull Request #11957