Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8731 Rich Placement constraints optimization and enhancements
  3. YARN-9258

Support to specify allocation tags without constraint in distributed shell CLI

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.3.0, 3.2.1
    • Component/s: distributed-shell
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      DistributedShell PlacementSpec fails to parse zk=1:spark=1,NOTIN,NODE,zk

      java.lang.IllegalArgumentException: Invalid placement spec: zk=1:spark=1,NOTIN,NODE,zk
      	at org.apache.hadoop.yarn.applications.distributedshell.PlacementSpec.parse(PlacementSpec.java:108)
      	at org.apache.hadoop.yarn.applications.distributedshell.Client.init(Client.java:462)
      	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.testDistributedShellWithPlacementConstraint(TestDistributedShell.java:1780)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.hadoop.yarn.util.constraint.PlacementConstraintParseException: Source allocation tags is required for a multi placement constraint expression.
      	at org.apache.hadoop.yarn.util.constraint.PlacementConstraintParser.parsePlacementSpec(PlacementConstraintParser.java:740)
      	at org.apache.hadoop.yarn.applications.distributedshell.PlacementSpec.parse(PlacementSpec.java:94)
      	... 16 more
      
      

        Attachments

        1. YARN-9258-001.patch
          9 kB
          Prabhu Joseph
        2. YARN-9258-002.patch
          22 kB
          Prabhu Joseph
        3. YARN-9258-003.patch
          26 kB
          Prabhu Joseph
        4. YARN-9258-004.patch
          26 kB
          Prabhu Joseph
        5. YARN-9258-005.patch
          25 kB
          Weiwei Yang

          Activity

            People

            • Assignee:
              prabhujoseph Prabhu Joseph
              Reporter:
              prabhujoseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: