Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812 Improvements to Rich Placement Constraints in YARN
  3. YARN-7791

Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: client

      Description

      Set yarn.resourcemanager.placement-constraints.enabled to false
      Submit a job with placement constraint spec, e.g

      in/yarn org.apache.hadoop.yarn.applications.distributedshell.Client -jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0-SNAPSHOT.jar -shell_command sleep -shell_args 30 -num_containers 2 -master_memory 500 -container_memory 200 -placement_spec foo=4,NOTIN,NODE,foo
      

      got following errors in RM log

      Exception message:As of now, the only accepted target key for targetKey of allocation_tag target expression is: [yarn_application_label/%intra_app%]. Please make changes to placement constraints accordingly.
      

      Looks like DS needs some modification to support submitting proper scheduling requests to app placement allocators.

        Attachments

          Activity

            People

            • Assignee:
              sunilg Sunil G
              Reporter:
              cheersyang Weiwei Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: