[YARN-7791] Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Component/s: client
• Labels: distributedshell
• Target Version/s: YARN-6592
• Assignee: Sunil G
• Reporter: Weiwei Yang
• Created: 23/Jan/18 07:18
• Updated: 11/Apr/18 09:59
• Resolved: 11/Apr/18 09:59

Description

Set yarn.resourcemanager.placement-constraints.enabled to false
Submit a job with placement constraint spec, e.g

in/yarn org.apache.hadoop.yarn.applications.distributedshell.Client -jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0-SNAPSHOT.jar -shell_command sleep -shell_args 30 -num_containers 2 -master_memory 500 -container_memory 200 -placement_spec foo=4,NOTIN,NODE,foo

got following errors in RM log

Exception message:As of now, the only accepted target key for targetKey of allocation_tag target expression is: [yarn_application_label/%intra_app%]. Please make changes to placement constraints accordingly.

Looks like DS needs some modification to support submitting proper scheduling requests to app placement allocators.