[FLINK-4998] ResourceManager fails when num task slots > Yarn vcores

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.3, 1.2.0
• Fix Version/s: 1.1.4, 1.2.0
• Component/s: Deployment / YARN, Runtime / Coordination
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 02/Nov/16 15:42
• Updated: 28/Feb/19 14:00
• Resolved: 04/Nov/16 19:16

Description

The ResourceManager fails to acquire containers when the users configures the number of task slots to be greater than the maximum number of virtual cores of the Yarn cluster.

We should check during deployment that the task slots are not configured to be larger than the virtual cores.

2016-11-02 14:39:01,948 ERROR org.apache.flink.yarn.YarnFlinkResourceManager                - FATAL ERROR IN YARN APPLICATION MASTER: Connection to YARN Resource Manager failed
org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested virtual cores < 0, or requested virtual cores > max configured, requestedVirtualCores=3, maxVirtualCores=1

Issue Links

• is duplicated by: FLINK-3787 Yarn client does not report unfulfillable container constraints
• is related to: FLINK-2213 Configure number of vcores
• links to: GitHub Pull Request #2741