Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4491

yarn list command to support filtering by tags

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      although you can filter the list of yarn applications using the --appTypes option; you can't use application tags. For finding applications on large processes, adding a --tag option would allow users to be more selective

      example:

      yarn list --appTypes SPARK --tag production
      

        Activity

        Hide
        varun_saxena Varun Saxena added a comment -

        Sample Output :

        varun@varun-Inspiron-5558:~/hadoop/bin$ ./yarn application -list --appStates FINISHED --appTags tag1
        Total number of applications (application-types: [], states: [FINISHED] and tags: [tag1]):1
                        Application-Id	    Application-Name	    Application-Type	      User	     Queue	             State	       Final-State	       Progress	                       Tracking-URL
        application_1454226137194_0003	           Sleep job	           MAPREDUCE	      varun	    default	          FINISHED	         SUCCEEDED	           100%	http://varun-Inspiron-5558:19888/jobhistory/job/job_1454226137194_0003
        
        Show
        varun_saxena Varun Saxena added a comment - Sample Output : varun@varun-Inspiron-5558:~/hadoop/bin$ ./yarn application -list --appStates FINISHED --appTags tag1 Total number of applications (application-types: [], states: [FINISHED] and tags: [tag1]):1 Application-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL application_1454226137194_0003 Sleep job MAPREDUCE varun default FINISHED SUCCEEDED 100% http://varun-Inspiron-5558:19888/jobhistory/job/job_1454226137194_0003
        Hide
        varun_saxena Varun Saxena added a comment -

        Steve, would you want tags to be displayed against each application in the output as well ?

        Show
        varun_saxena Varun Saxena added a comment - Steve, would you want tags to be displayed against each application in the output as well ?
        Hide
        varun_saxena Varun Saxena added a comment -

        Jenkins slave went offline during build.
        I have invoked the build manually from Jenkins again.

        Show
        varun_saxena Varun Saxena added a comment - Jenkins slave went offline during build. I have invoked the build manually from Jenkins again.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 51s Maven dependency ordering for branch
        +1 mvninstall 6m 52s trunk passed
        +1 compile 6m 32s trunk passed with JDK v1.8.0_66
        +1 compile 7m 5s trunk passed with JDK v1.7.0_91
        +1 checkstyle 1m 5s trunk passed
        +1 mvnsite 0m 53s trunk passed
        +1 mvneclipse 0m 28s trunk passed
        +1 findbugs 1m 4s trunk passed
        +1 javadoc 0m 29s trunk passed with JDK v1.8.0_66
        +1 javadoc 0m 33s trunk passed with JDK v1.7.0_91
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 0m 41s the patch passed
        +1 compile 6m 5s the patch passed with JDK v1.8.0_66
        +1 javac 6m 5s the patch passed
        +1 compile 7m 5s the patch passed with JDK v1.7.0_91
        +1 javac 7m 5s the patch passed
        -1 checkstyle 1m 6s root: patch generated 1 new + 77 unchanged - 3 fixed = 78 total (was 80)
        +1 mvnsite 0m 53s the patch passed
        +1 mvneclipse 0m 27s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 1m 28s the patch passed
        +1 javadoc 0m 28s the patch passed with JDK v1.8.0_66
        +1 javadoc 0m 34s the patch passed with JDK v1.7.0_91
        -1 unit 64m 33s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
        -1 unit 98m 15s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_66.
        -1 unit 64m 56s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
        -1 unit 111m 21s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_91.
        -1 asflicense 0m 26s Patch generated 15 ASF License warnings.
        385m 57s



        Reason Tests
        JDK v1.8.0_66 Failed junit tests hadoop.yarn.client.TestGetGroups
          hadoop.mapreduce.v2.TestMRJobsWithProfiler
          hadoop.mapred.TestNetworkedJob
        JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
          org.apache.hadoop.yarn.client.api.impl.TestYarnClient
          org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
          org.apache.hadoop.yarn.client.api.impl.TestNMClient
        JDK v1.7.0_91 Failed junit tests hadoop.yarn.client.TestGetGroups
          hadoop.mapred.TestNetworkedJob
        JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
          org.apache.hadoop.yarn.client.api.impl.TestYarnClient
          org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
          org.apache.hadoop.yarn.client.api.impl.TestNMClient
          org.apache.hadoop.mapred.TestMRIntermediateDataEncryption



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:0ca8df7
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch
        JIRA Issue YARN-4491
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 65e256b1d792 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 2673cba
        Default Java 1.7.0_91
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/diff-checkstyle-root.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_66.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_91.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_91.txt
        JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10451/testReport/
        asflicense https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .
        Max memory used 76MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/10451/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 51s Maven dependency ordering for branch +1 mvninstall 6m 52s trunk passed +1 compile 6m 32s trunk passed with JDK v1.8.0_66 +1 compile 7m 5s trunk passed with JDK v1.7.0_91 +1 checkstyle 1m 5s trunk passed +1 mvnsite 0m 53s trunk passed +1 mvneclipse 0m 28s trunk passed +1 findbugs 1m 4s trunk passed +1 javadoc 0m 29s trunk passed with JDK v1.8.0_66 +1 javadoc 0m 33s trunk passed with JDK v1.7.0_91 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 0m 41s the patch passed +1 compile 6m 5s the patch passed with JDK v1.8.0_66 +1 javac 6m 5s the patch passed +1 compile 7m 5s the patch passed with JDK v1.7.0_91 +1 javac 7m 5s the patch passed -1 checkstyle 1m 6s root: patch generated 1 new + 77 unchanged - 3 fixed = 78 total (was 80) +1 mvnsite 0m 53s the patch passed +1 mvneclipse 0m 27s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 1m 28s the patch passed +1 javadoc 0m 28s the patch passed with JDK v1.8.0_66 +1 javadoc 0m 34s the patch passed with JDK v1.7.0_91 -1 unit 64m 33s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. -1 unit 98m 15s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_66. -1 unit 64m 56s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. -1 unit 111m 21s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_91. -1 asflicense 0m 26s Patch generated 15 ASF License warnings. 385m 57s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.client.TestGetGroups   hadoop.mapreduce.v2.TestMRJobsWithProfiler   hadoop.mapred.TestNetworkedJob JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.client.TestGetGroups   hadoop.mapred.TestNetworkedJob JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient   org.apache.hadoop.mapred.TestMRIntermediateDataEncryption Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch JIRA Issue YARN-4491 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 65e256b1d792 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 2673cba Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10451/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/10451/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: . Max memory used 76MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10451/console This message was automatically generated.
        Hide
        varun_saxena Varun Saxena added a comment -

        Steve Loughran, kindly review.
        For the test case failures, all tests bar TestNetworkedJob pass for me locally. We have MAPREDUCE-6579 to track this failure.

        Yarn client related test cases have been failing since a while due to incorrect /etc/hosts mapping in Jenkins machines. The domain name does not have a trailing dot which is leading to failures and timeouts.
        With appropriate entry in /etc/hosts, tests pass locally.
        I believe Rohith Sharma K S has filed an INFRA JIRA for this.

        Checkstyle issue is related to ApplicationCLI#run method having more than 150 lines. This method already had more than 150 lines. Do you want me to refactor it to reduce number of lines ?

        Show
        varun_saxena Varun Saxena added a comment - Steve Loughran , kindly review. For the test case failures, all tests bar TestNetworkedJob pass for me locally. We have MAPREDUCE-6579 to track this failure. Yarn client related test cases have been failing since a while due to incorrect /etc/hosts mapping in Jenkins machines. The domain name does not have a trailing dot which is leading to failures and timeouts. With appropriate entry in /etc/hosts, tests pass locally. I believe Rohith Sharma K S has filed an INFRA JIRA for this. Checkstyle issue is related to ApplicationCLI#run method having more than 150 lines. This method already had more than 150 lines. Do you want me to refactor it to reduce number of lines ?
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Varun Saxena, seems to be a usefull functionality, will retrigger jenkins to see whether patch gets applied even now !

        Show
        Naganarasimha Naganarasimha G R added a comment - Varun Saxena , seems to be a usefull functionality, will retrigger jenkins to see whether patch gets applied even now !
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 14s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 14s Maven dependency ordering for branch
        +1 mvninstall 6m 44s trunk passed
        +1 compile 7m 37s trunk passed
        +1 checkstyle 1m 33s trunk passed
        +1 mvnsite 1m 5s trunk passed
        +1 mvneclipse 0m 34s trunk passed
        +1 findbugs 0m 58s trunk passed
        +1 javadoc 0m 31s trunk passed
        0 mvndep 0m 16s Maven dependency ordering for patch
        +1 mvninstall 0m 50s the patch passed
        +1 compile 8m 16s the patch passed
        +1 javac 8m 16s the patch passed
        -1 checkstyle 1m 31s root: The patch generated 11 new + 199 unchanged - 9 fixed = 210 total (was 208)
        +1 mvnsite 1m 5s the patch passed
        +1 mvneclipse 0m 32s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 20s the patch passed
        -1 javadoc 0m 17s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client generated 2 new + 155 unchanged - 0 fixed = 157 total (was 155)
        +1 unit 8m 47s hadoop-yarn-client in the patch passed.
        +1 unit 110m 51s hadoop-mapreduce-client-jobclient in the patch passed.
        +1 asflicense 0m 28s The patch does not generate ASF License warnings.
        154m 54s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch
        JIRA Issue YARN-4491
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 0e49708f81f5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 522ddbd
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12691/artifact/patchprocess/diff-checkstyle-root.txt
        javadoc https://builds.apache.org/job/PreCommit-YARN-Build/12691/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12691/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/12691/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 14s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 14s Maven dependency ordering for branch +1 mvninstall 6m 44s trunk passed +1 compile 7m 37s trunk passed +1 checkstyle 1m 33s trunk passed +1 mvnsite 1m 5s trunk passed +1 mvneclipse 0m 34s trunk passed +1 findbugs 0m 58s trunk passed +1 javadoc 0m 31s trunk passed 0 mvndep 0m 16s Maven dependency ordering for patch +1 mvninstall 0m 50s the patch passed +1 compile 8m 16s the patch passed +1 javac 8m 16s the patch passed -1 checkstyle 1m 31s root: The patch generated 11 new + 199 unchanged - 9 fixed = 210 total (was 208) +1 mvnsite 1m 5s the patch passed +1 mvneclipse 0m 32s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 20s the patch passed -1 javadoc 0m 17s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client generated 2 new + 155 unchanged - 0 fixed = 157 total (was 155) +1 unit 8m 47s hadoop-yarn-client in the patch passed. +1 unit 110m 51s hadoop-mapreduce-client-jobclient in the patch passed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 154m 54s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch JIRA Issue YARN-4491 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 0e49708f81f5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 522ddbd Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12691/artifact/patchprocess/diff-checkstyle-root.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/12691/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12691/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/12691/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 16s Maven dependency ordering for branch
        +1 mvninstall 8m 2s trunk passed
        +1 compile 8m 36s trunk passed
        +1 checkstyle 1m 36s trunk passed
        +1 mvnsite 0m 58s trunk passed
        +1 mvneclipse 0m 31s trunk passed
        +1 findbugs 1m 0s trunk passed
        +1 javadoc 0m 28s trunk passed
        0 mvndep 0m 16s Maven dependency ordering for patch
        +1 mvninstall 0m 49s the patch passed
        +1 compile 7m 17s the patch passed
        +1 javac 7m 17s the patch passed
        -1 checkstyle 1m 27s root: The patch generated 11 new + 199 unchanged - 9 fixed = 210 total (was 208)
        +1 mvnsite 0m 57s the patch passed
        +1 mvneclipse 0m 33s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 13s the patch passed
        -1 javadoc 0m 15s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client generated 2 new + 155 unchanged - 0 fixed = 157 total (was 155)
        -1 unit 8m 34s hadoop-yarn-client in the patch failed.
        +1 unit 110m 24s hadoop-mapreduce-client-jobclient in the patch passed.
        +1 asflicense 0m 29s The patch does not generate ASF License warnings.
        155m 4s



        Reason Tests
        Failed junit tests hadoop.yarn.client.api.impl.TestYarnClient
          hadoop.yarn.client.api.impl.TestAMRMClient



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch
        JIRA Issue YARN-4491
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 91c59caf4d7d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 522ddbd
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/diff-checkstyle-root.txt
        javadoc https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12692/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/12692/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 16s Maven dependency ordering for branch +1 mvninstall 8m 2s trunk passed +1 compile 8m 36s trunk passed +1 checkstyle 1m 36s trunk passed +1 mvnsite 0m 58s trunk passed +1 mvneclipse 0m 31s trunk passed +1 findbugs 1m 0s trunk passed +1 javadoc 0m 28s trunk passed 0 mvndep 0m 16s Maven dependency ordering for patch +1 mvninstall 0m 49s the patch passed +1 compile 7m 17s the patch passed +1 javac 7m 17s the patch passed -1 checkstyle 1m 27s root: The patch generated 11 new + 199 unchanged - 9 fixed = 210 total (was 208) +1 mvnsite 0m 57s the patch passed +1 mvneclipse 0m 33s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 13s the patch passed -1 javadoc 0m 15s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client generated 2 new + 155 unchanged - 0 fixed = 157 total (was 155) -1 unit 8m 34s hadoop-yarn-client in the patch failed. +1 unit 110m 24s hadoop-mapreduce-client-jobclient in the patch passed. +1 asflicense 0m 29s The patch does not generate ASF License warnings. 155m 4s Reason Tests Failed junit tests hadoop.yarn.client.api.impl.TestYarnClient   hadoop.yarn.client.api.impl.TestAMRMClient Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785416/YARN-4491.01.patch JIRA Issue YARN-4491 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 91c59caf4d7d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 522ddbd Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/diff-checkstyle-root.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/12692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12692/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/12692/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        Naganarasimha Naganarasimha G R added a comment - - edited

        Hi Varun Saxena, Please check test TestYarnClient.testAMRMClientWithContainerResourceChange is applicable or not other issues are not related to the patch and correct the white space issues while committing!

        Show
        Naganarasimha Naganarasimha G R added a comment - - edited Hi Varun Saxena , Please check test TestYarnClient.testAMRMClientWithContainerResourceChange is applicable or not other issues are not related to the patch and correct the white space issues while committing!
        Hide
        varun_saxena Varun Saxena added a comment -

        Naganarasimha Garla, the failure is not related. I was able to simulate the failure locally without applying YARN-4491 patch.

        Show
        varun_saxena Varun Saxena added a comment - Naganarasimha Garla , the failure is not related. I was able to simulate the failure locally without applying YARN-4491 patch.
        Hide
        varun_saxena Varun Saxena added a comment -

        Filed YARN-5537 to track test failure.

        Show
        varun_saxena Varun Saxena added a comment - Filed YARN-5537 to track test failure.
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks for the update Varun Saxena, I also applied the patch on top of trunk and tested it with few combinations of tags (with equals etc ... ) and seems to be working fine. But had a feeling that tag filtering should be much more comprehensive with support of patterns etc.. but seems to be out of scope of this jira as focus of this jira is to just make use of the existing interface in ApplicationClientProtocol
        So overall patch LGTM, Steve Loughran hope you could also review.
        If no further comments, will commit the patch tomorrow !

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks for the update Varun Saxena , I also applied the patch on top of trunk and tested it with few combinations of tags (with equals etc ... ) and seems to be working fine. But had a feeling that tag filtering should be much more comprehensive with support of patterns etc.. but seems to be out of scope of this jira as focus of this jira is to just make use of the existing interface in ApplicationClientProtocol So overall patch LGTM, Steve Loughran hope you could also review. If no further comments, will commit the patch tomorrow !
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks for contribution Varun Saxena and Steve Loughran for raising the issue. Have committed the patch in trunk and branch-2.

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks for contribution Varun Saxena and Steve Loughran for raising the issue. Have committed the patch in trunk and branch-2.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10331 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10331/)
        YARN-4491. yarn list command to support filtering by tags. Contributed (naganarasimha_gr: rev 143c59e4c5a811eb2c12cf6626d558f9b8796e03)

        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java
        • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10331 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10331/ ) YARN-4491 . yarn list command to support filtering by tags. Contributed (naganarasimha_gr: rev 143c59e4c5a811eb2c12cf6626d558f9b8796e03) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
        Hide
        varun_saxena Varun Saxena added a comment -

        Thanks Naganarasimha Garla for the review and commit. And thanks Steve Loughran for raising the issue.

        Show
        varun_saxena Varun Saxena added a comment - Thanks Naganarasimha Garla for the review and commit. And thanks Steve Loughran for raising the issue.

          People

          • Assignee:
            varun_saxena Varun Saxena
            Reporter:
            stevel@apache.org Steve Loughran
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development