[FLINK-5903] taskmanager.numberOfTaskSlots and yarn.containers.vcores did not work well in YARN mode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: Deployment / YARN
• Assignee: Tao Wang
• Reporter: Tao Wang
• Created: 24/Feb/17 07:21
• Updated: 31/Mar/17 13:39
• Resolved: 31/Mar/17 13:39

Description

Now Flink did not respect taskmanager.numberOfTaskSlots and yarn.containers.vcores in flink-conf.yaml, but only -s parameter in CLI.

Details is that taskmanager.numberOfTaskSlots is not working in anyway andyarn.containers.vcores is only used in requesting container(TM) resources but not aware to TM, which means TM will always think it has default(1) Slots if -s is not configured.

Issue Links

• links to: GitHub Pull Request #3408