Details

    • Hadoop Flags:
      Reviewed

      Description

      Currently nodelabel stats per application is not available through REST like currently used labels by all live containers, total stats of containers per label for app etc..

      CLI and web UI scenarios will be handled separately.

      1. 0001-YARN-4498.patch
        4 kB
        Bibin A Chundatt
      2. apps.xml
        7 kB
        Bibin A Chundatt
      3. YARN-4498.0002.patch
        2 kB
        Bibin A Chundatt
      4. YARN-4498.0003.patch
        13 kB
        Bibin A Chundatt
      5. YARN-4498.0004.patch
        12 kB
        Bibin A Chundatt
      6. YARN-4498.addendum.001.patch
        3 kB
        Bibin A Chundatt
      7. YARN-4498.branch-2.8.0001.patch
        12 kB
        Bibin A Chundatt
      8. YARN-4498.branch-2.8.addendum.001.patch
        3 kB
        Bibin A Chundatt

        Activity

        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching Rest API update for returning stats per partition

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching Rest API update for returning stats per partition
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 6m 26s trunk passed
        +1 compile 0m 26s trunk passed with JDK v1.8.0_92
        +1 compile 0m 29s trunk passed with JDK v1.7.0_95
        +1 checkstyle 0m 18s trunk passed
        +1 mvnsite 0m 34s trunk passed
        +1 mvneclipse 0m 15s trunk passed
        +1 findbugs 1m 5s trunk passed
        +1 javadoc 0m 20s trunk passed with JDK v1.8.0_92
        +1 javadoc 0m 26s trunk passed with JDK v1.7.0_95
        +1 mvninstall 0m 30s the patch passed
        +1 compile 0m 24s the patch passed with JDK v1.8.0_92
        +1 javac 0m 24s the patch passed
        +1 compile 0m 26s the patch passed with JDK v1.7.0_95
        +1 javac 0m 26s the patch passed
        -1 checkstyle 0m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: patch generated 1 new + 82 unchanged - 0 fixed = 83 total (was 82)
        +1 mvnsite 0m 32s the patch passed
        +1 mvneclipse 0m 12s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 1m 13s the patch passed
        +1 javadoc 0m 17s the patch passed with JDK v1.8.0_92
        +1 javadoc 0m 23s the patch passed with JDK v1.7.0_95
        -1 unit 43m 10s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_92.
        -1 unit 43m 40s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95.
        +1 asflicense 0m 16s Patch does not generate ASF License warnings.
        102m 51s



        Reason Tests
        JDK v1.8.0_92 Failed junit tests hadoop.yarn.server.resourcemanager.TestAMAuthorization
          hadoop.yarn.server.resourcemanager.TestClientRMTokens
        JDK v1.8.0_92 Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes
        JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestAMAuthorization
          hadoop.yarn.server.resourcemanager.TestContainerResourceUsage
          hadoop.yarn.server.resourcemanager.TestClientRMTokens
        JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:cf2ee45
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12801652/0001-YARN-4498.patch
        JIRA Issue YARN-4498
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 021f3a1b101c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 971af60
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_92 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_92.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_92.txt https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11297/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/11297/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 6m 26s trunk passed +1 compile 0m 26s trunk passed with JDK v1.8.0_92 +1 compile 0m 29s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 18s trunk passed +1 mvnsite 0m 34s trunk passed +1 mvneclipse 0m 15s trunk passed +1 findbugs 1m 5s trunk passed +1 javadoc 0m 20s trunk passed with JDK v1.8.0_92 +1 javadoc 0m 26s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 30s the patch passed +1 compile 0m 24s the patch passed with JDK v1.8.0_92 +1 javac 0m 24s the patch passed +1 compile 0m 26s the patch passed with JDK v1.7.0_95 +1 javac 0m 26s the patch passed -1 checkstyle 0m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: patch generated 1 new + 82 unchanged - 0 fixed = 83 total (was 82) +1 mvnsite 0m 32s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 1m 13s the patch passed +1 javadoc 0m 17s the patch passed with JDK v1.8.0_92 +1 javadoc 0m 23s the patch passed with JDK v1.7.0_95 -1 unit 43m 10s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_92. -1 unit 43m 40s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 16s Patch does not generate ASF License warnings. 102m 51s Reason Tests JDK v1.8.0_92 Failed junit tests hadoop.yarn.server.resourcemanager.TestAMAuthorization   hadoop.yarn.server.resourcemanager.TestClientRMTokens JDK v1.8.0_92 Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestAMAuthorization   hadoop.yarn.server.resourcemanager.TestContainerResourceUsage   hadoop.yarn.server.resourcemanager.TestClientRMTokens JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12801652/0001-YARN-4498.patch JIRA Issue YARN-4498 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 021f3a1b101c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 971af60 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_92 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_92.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_92.txt https://builds.apache.org/job/PreCommit-YARN-Build/11297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11297/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/11297/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching updated patch after adding partition level usage to rest API

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching updated patch after adding partition level usage to rest API
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching sample xml file for application rest API
        For each partition the usage stats will be shown

        <resourceUsagesByPartition>
        <partitionName>labelx</partitionName>
        <used><memory>1536</memory><vCores>1</vCores></used><reserved><memory>0</memory><vCores>0</vCores></reserved><pending><memory>0</memory><vCores>0</vCores></pending><amUsed><memory>1536</memory><vCores>1</vCores></amUsed><amLimit><memory>0</memory><vCores>0</vCores></amLimit></resourceUsagesByPartition>
        
        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching sample xml file for application rest API For each partition the usage stats will be shown <resourceUsagesByPartition> <partitionName>labelx</partitionName> <used><memory>1536</memory><vCores>1</vCores></used><reserved><memory>0</memory><vCores>0</vCores></reserved><pending><memory>0</memory><vCores>0</vCores></pending><amUsed><memory>1536</memory><vCores>1</vCores></amUsed><amLimit><memory>0</memory><vCores>0</vCores></amLimit></resourceUsagesByPartition>
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks Bibin A Chundatt for the patch, hope you can segregate the UI, REST and CLI into 2 or more patches and also capture some test case for the same. XML Out put looks fine enough !

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks Bibin A Chundatt for the patch, hope you can segregate the UI, REST and CLI into 2 or more patches and also capture some test case for the same. XML Out put looks fine enough !
        Hide
        xgong Xuan Gong added a comment -

        Thanks for working on this. Could you add the test case for this, please ?

        Show
        xgong Xuan Gong added a comment - Thanks for working on this. Could you add the test case for this, please ?
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching patch with testcase

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching patch with testcase
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 11s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 6m 57s trunk passed
        +1 compile 0m 32s trunk passed
        +1 checkstyle 0m 21s trunk passed
        +1 mvnsite 0m 37s trunk passed
        +1 mvneclipse 0m 16s trunk passed
        +1 findbugs 0m 56s trunk passed
        +1 javadoc 0m 20s trunk passed
        +1 mvninstall 0m 31s the patch passed
        +1 compile 0m 29s the patch passed
        +1 javac 0m 29s the patch passed
        -0 checkstyle 0m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 14 new + 42 unchanged - 1 fixed = 56 total (was 43)
        +1 mvnsite 0m 36s the patch passed
        +1 mvneclipse 0m 13s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 1s the patch passed
        +1 javadoc 0m 18s the patch passed
        +1 unit 35m 17s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        50m 26s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-4498
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835829/YARN-4498.0003.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 8f6ab9488ddb 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / c017171
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13636/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13636/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13636/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 57s trunk passed +1 compile 0m 32s trunk passed +1 checkstyle 0m 21s trunk passed +1 mvnsite 0m 37s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 0m 56s trunk passed +1 javadoc 0m 20s trunk passed +1 mvninstall 0m 31s the patch passed +1 compile 0m 29s the patch passed +1 javac 0m 29s the patch passed -0 checkstyle 0m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 14 new + 42 unchanged - 1 fixed = 56 total (was 43) +1 mvnsite 0m 36s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 1s the patch passed +1 javadoc 0m 18s the patch passed +1 unit 35m 17s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 17s The patch does not generate ASF License warnings. 50m 26s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-4498 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835829/YARN-4498.0003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 8f6ab9488ddb 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c017171 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13636/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13636/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/13636/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        Naganarasimha Naganarasimha G R added a comment - - edited

        Bibin A Chundatt,
        +1 , Latest Patch LGTM will commit it shortly !

        Show
        Naganarasimha Naganarasimha G R added a comment - - edited Bibin A Chundatt , +1 , Latest Patch LGTM will commit it shortly !
        Hide
        bibinchundatt Bibin A Chundatt added a comment - - edited

        Attaching patch after handling check style issues

        Show
        bibinchundatt Bibin A Chundatt added a comment - - edited Attaching patch after handling check style issues
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 6m 48s trunk passed
        +1 compile 0m 31s trunk passed
        +1 checkstyle 0m 20s trunk passed
        +1 mvnsite 0m 38s trunk passed
        +1 mvneclipse 0m 16s trunk passed
        +1 findbugs 0m 58s trunk passed
        +1 javadoc 0m 22s trunk passed
        +1 mvninstall 0m 30s the patch passed
        +1 compile 0m 29s the patch passed
        +1 javac 0m 29s the patch passed
        -0 checkstyle 0m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 42 unchanged - 1 fixed = 43 total (was 43)
        +1 mvnsite 0m 34s the patch passed
        +1 mvneclipse 0m 13s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 2s the patch passed
        +1 javadoc 0m 18s the patch passed
        -1 unit 38m 16s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 15s The patch does not generate ASF License warnings.
        53m 19s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-4498
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835869/YARN-4498.0004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux a3d0ab31314f 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 8a9388e
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13646/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13646/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13646/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13646/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 48s trunk passed +1 compile 0m 31s trunk passed +1 checkstyle 0m 20s trunk passed +1 mvnsite 0m 38s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 0m 58s trunk passed +1 javadoc 0m 22s trunk passed +1 mvninstall 0m 30s the patch passed +1 compile 0m 29s the patch passed +1 javac 0m 29s the patch passed -0 checkstyle 0m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 42 unchanged - 1 fixed = 43 total (was 43) +1 mvnsite 0m 34s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 2s the patch passed +1 javadoc 0m 18s the patch passed -1 unit 38m 16s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 15s The patch does not generate ASF License warnings. 53m 19s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-4498 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835869/YARN-4498.0004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux a3d0ab31314f 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 8a9388e Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13646/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13646/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13646/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/13646/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10730 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10730/)
        YARN-4498. Application level node labels stats to be available in REST. (naganarasimha_gr: rev e0bebbbcddce743082374e0f26b39b154f5775f3)

        • (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10730 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10730/ ) YARN-4498 . Application level node labels stats to be available in REST. (naganarasimha_gr: rev e0bebbbcddce743082374e0f26b39b154f5775f3) (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Hi Bibin A Chundatt,
        Thanks for the latest patch and test case failure is not related to the patch, and check style issue is not required to be fixed. +1 Latest patch LGTM, committed it trunk but the patch fails for branch-2, can you please check and rebase for 2.9 and 2.8.

        Show
        Naganarasimha Naganarasimha G R added a comment - Hi Bibin A Chundatt , Thanks for the latest patch and test case failure is not related to the patch, and check style issue is not required to be fixed. +1 Latest patch LGTM, committed it trunk but the patch fails for branch-2 , can you please check and rebase for 2.9 and 2.8.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Thank you Naganarasimha G R for review and commit. Looked into patch apply on branch-2 and 2.8, both are working fine.
        Probably the new file added caused the issue.Could you check again.

        Show
        bibinchundatt Bibin A Chundatt added a comment - Thank you Naganarasimha G R for review and commit. Looked into patch apply on branch-2 and 2.8, both are working fine. Probably the new file added caused the issue.Could you check again.
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Sorry Bibin A Chundatt, i should have been more elaborate... Compilation fails after cherry pick to branch-2,

        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project hadoop-yarn-server-resourcemanager: Compilation failure: Compilation failure:
        [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[44,37] cannot find symbol
        [ERROR] symbol:   class GuiceServletConfig
        [ERROR] location: package org.apache.hadoop.yarn.webapp
        [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[107,35] cannot find symbol
        [ERROR] symbol:   class GuiceServletConfig
        [ERROR] location: class org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServiceAppsNodelabel
        [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[138,5] cannot find symbol
        [ERROR] symbol:   variable GuiceServletConfig
        [ERROR] location: class org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServiceAppsNodelabel
        [ERROR] -> [Help 1]
        [ERROR] 
        
        Show
        Naganarasimha Naganarasimha G R added a comment - Sorry Bibin A Chundatt , i should have been more elaborate... Compilation fails after cherry pick to branch-2, [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile ( default -testCompile) on project hadoop-yarn-server-resourcemanager: Compilation failure: Compilation failure: [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[44,37] cannot find symbol [ERROR] symbol: class GuiceServletConfig [ERROR] location: package org.apache.hadoop.yarn.webapp [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[107,35] cannot find symbol [ERROR] symbol: class GuiceServletConfig [ERROR] location: class org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServiceAppsNodelabel [ERROR] /opt/git/commit/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java:[138,5] cannot find symbol [ERROR] symbol: variable GuiceServletConfig [ERROR] location: class org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServiceAppsNodelabel [ERROR] -> [Help 1] [ERROR]
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        HADOOP-9613 is available only in trunk

        Show
        bibinchundatt Bibin A Chundatt added a comment - HADOOP-9613 is available only in trunk
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        agree but how difficult is it to backport the patch ? IIUC it should be only test case failing may be we can refer other test classes of branch-2 code to test REST calls ?

        Show
        Naganarasimha Naganarasimha G R added a comment - agree but how difficult is it to backport the patch ? IIUC it should be only test case failing may be we can refer other test classes of branch-2 code to test REST calls ?
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching patch for branch2.8

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching patch for branch2.8
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 6m 22s branch-2.8 passed
        +1 compile 0m 26s branch-2.8 passed with JDK v1.8.0_111
        +1 compile 0m 30s branch-2.8 passed with JDK v1.7.0_111
        +1 checkstyle 0m 18s branch-2.8 passed
        +1 mvnsite 0m 36s branch-2.8 passed
        +1 mvneclipse 0m 16s branch-2.8 passed
        +1 findbugs 1m 6s branch-2.8 passed
        +1 javadoc 0m 19s branch-2.8 passed with JDK v1.8.0_111
        +1 javadoc 0m 23s branch-2.8 passed with JDK v1.7.0_111
        +1 mvninstall 0m 30s the patch passed
        +1 compile 0m 24s the patch passed with JDK v1.8.0_111
        +1 javac 0m 24s the patch passed
        +1 compile 0m 28s the patch passed with JDK v1.7.0_111
        +1 javac 0m 28s the patch passed
        -0 checkstyle 0m 15s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 44 unchanged - 1 fixed = 45 total (was 45)
        +1 mvnsite 0m 33s the patch passed
        +1 mvneclipse 0m 13s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 15s the patch passed
        +1 javadoc 0m 17s the patch passed with JDK v1.8.0_111
        +1 javadoc 0m 20s the patch passed with JDK v1.7.0_111
        -1 unit 75m 19s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_111.
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        166m 5s



        Reason Tests
        JDK v1.8.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestAMAuthorization
        JDK v1.7.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestAMAuthorization



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:5af2af1
        JIRA Issue YARN-4498
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836128/YARN-4498.branch-2.8.0001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 951c431fcb92 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.8 / 757b38e
        Default Java 1.7.0_111
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_111 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13692/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_111.txt
        JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13692/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13692/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 22s branch-2.8 passed +1 compile 0m 26s branch-2.8 passed with JDK v1.8.0_111 +1 compile 0m 30s branch-2.8 passed with JDK v1.7.0_111 +1 checkstyle 0m 18s branch-2.8 passed +1 mvnsite 0m 36s branch-2.8 passed +1 mvneclipse 0m 16s branch-2.8 passed +1 findbugs 1m 6s branch-2.8 passed +1 javadoc 0m 19s branch-2.8 passed with JDK v1.8.0_111 +1 javadoc 0m 23s branch-2.8 passed with JDK v1.7.0_111 +1 mvninstall 0m 30s the patch passed +1 compile 0m 24s the patch passed with JDK v1.8.0_111 +1 javac 0m 24s the patch passed +1 compile 0m 28s the patch passed with JDK v1.7.0_111 +1 javac 0m 28s the patch passed -0 checkstyle 0m 15s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 44 unchanged - 1 fixed = 45 total (was 45) +1 mvnsite 0m 33s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 15s the patch passed +1 javadoc 0m 17s the patch passed with JDK v1.8.0_111 +1 javadoc 0m 20s the patch passed with JDK v1.7.0_111 -1 unit 75m 19s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_111. +1 asflicense 0m 17s The patch does not generate ASF License warnings. 166m 5s Reason Tests JDK v1.8.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestAMAuthorization JDK v1.7.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestAMAuthorization Subsystem Report/Notes Docker Image:yetus/hadoop:5af2af1 JIRA Issue YARN-4498 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836128/YARN-4498.branch-2.8.0001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 951c431fcb92 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / 757b38e Default Java 1.7.0_111 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_111 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13692/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13692/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_111.txt JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13692/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/13692/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks for the contribution Bibin A Chundatt and Xuan Gong for additional review, have committed the same to trunk, branch-2 and branch-2.8.

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks for the contribution Bibin A Chundatt and Xuan Gong for additional review, have committed the same to trunk, branch-2 and branch-2.8.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Thank you Naganarasimha G R for review and commit.Forgot to mention about the minor test change . In 2.8 the xml <resourceInfo/> is "resourceInfo":null but in trunk its "resourceInfo":{} updated testcase based on that too. xml of both are same.

        Show
        bibinchundatt Bibin A Chundatt added a comment - Thank you Naganarasimha G R for review and commit.Forgot to mention about the minor test change . In 2.8 the xml <resourceInfo/> is "resourceInfo":null but in trunk its "resourceInfo":{} updated testcase based on that too. xml of both are same.
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        It looks like an issue in branch-2.8. Bibin A Chundatt could you check it why null is coming? And also can you update a patch if you know the reason?
        cc:/ Naganarasimha G R

        Show
        rohithsharma Rohith Sharma K S added a comment - It looks like an issue in branch-2.8. Bibin A Chundatt could you check it why null is coming? And also can you update a patch if you know the reason? cc:/ Naganarasimha G R
        Hide
        bibinchundatt Bibin A Chundatt added a comment - - edited

        Thank you Rohith Sharma K S
        With Naganarasimha G R had discussed this offline and was planning to handle the same.
        Reopening the issue to handle null shown in json . For empty arrayList in case of 2.8 its returning null json. IIUC in case of json null is also considered empty. For making both trunk and 2.8 in sync will avoid resourceInfo for finished apps.

        Show
        bibinchundatt Bibin A Chundatt added a comment - - edited Thank you Rohith Sharma K S With Naganarasimha G R had discussed this offline and was planning to handle the same. Reopening the issue to handle null shown in json . For empty arrayList in case of 2.8 its returning null json. IIUC in case of json null is also considered empty. For making both trunk and 2.8 in sync will avoid resourceInfo for finished apps.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching patch for the same

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching patch for the same
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 20s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 9m 7s branch-2.8 passed
        +1 compile 0m 29s branch-2.8 passed with JDK v1.8.0_101
        +1 compile 0m 30s branch-2.8 passed with JDK v1.7.0_111
        +1 checkstyle 0m 18s branch-2.8 passed
        +1 mvnsite 0m 38s branch-2.8 passed
        +1 mvneclipse 0m 18s branch-2.8 passed
        +1 findbugs 1m 10s branch-2.8 passed
        +1 javadoc 0m 20s branch-2.8 passed with JDK v1.8.0_101
        +1 javadoc 0m 23s branch-2.8 passed with JDK v1.7.0_111
        +1 mvninstall 0m 29s the patch passed
        +1 compile 0m 24s the patch passed with JDK v1.8.0_101
        +1 javac 0m 24s the patch passed
        +1 compile 0m 28s the patch passed with JDK v1.7.0_111
        +1 javac 0m 28s the patch passed
        -0 checkstyle 0m 15s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 44 unchanged - 1 fixed = 45 total (was 45)
        +1 mvnsite 0m 33s the patch passed
        +1 mvneclipse 0m 14s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 16s the patch passed
        +1 javadoc 0m 16s the patch passed with JDK v1.8.0_101
        +1 javadoc 0m 20s the patch passed with JDK v1.7.0_111
        -1 unit 71m 45s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_111.
        +1 asflicense 0m 19s The patch does not generate ASF License warnings.
        162m 5s



        Reason Tests
        JDK v1.8.0_101 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
          hadoop.yarn.server.resourcemanager.TestAMAuthorization
        JDK v1.7.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestAMAuthorization



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:5af2af1
        JIRA Issue YARN-4498
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836609/YARN-4498.branch-2.8.addendum.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 5d7a2ac5e85a 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.8 / 7714282
        Default Java 1.7.0_111
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_101 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13756/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13756/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_111.txt
        JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13756/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13756/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 9m 7s branch-2.8 passed +1 compile 0m 29s branch-2.8 passed with JDK v1.8.0_101 +1 compile 0m 30s branch-2.8 passed with JDK v1.7.0_111 +1 checkstyle 0m 18s branch-2.8 passed +1 mvnsite 0m 38s branch-2.8 passed +1 mvneclipse 0m 18s branch-2.8 passed +1 findbugs 1m 10s branch-2.8 passed +1 javadoc 0m 20s branch-2.8 passed with JDK v1.8.0_101 +1 javadoc 0m 23s branch-2.8 passed with JDK v1.7.0_111 +1 mvninstall 0m 29s the patch passed +1 compile 0m 24s the patch passed with JDK v1.8.0_101 +1 javac 0m 24s the patch passed +1 compile 0m 28s the patch passed with JDK v1.7.0_111 +1 javac 0m 28s the patch passed -0 checkstyle 0m 15s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 44 unchanged - 1 fixed = 45 total (was 45) +1 mvnsite 0m 33s the patch passed +1 mvneclipse 0m 14s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 16s the patch passed +1 javadoc 0m 16s the patch passed with JDK v1.8.0_101 +1 javadoc 0m 20s the patch passed with JDK v1.7.0_111 -1 unit 71m 45s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_111. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 162m 5s Reason Tests JDK v1.8.0_101 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer   hadoop.yarn.server.resourcemanager.TestAMAuthorization JDK v1.7.0_111 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestAMAuthorization Subsystem Report/Notes Docker Image:yetus/hadoop:5af2af1 JIRA Issue YARN-4498 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836609/YARN-4498.branch-2.8.addendum.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 5d7a2ac5e85a 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / 7714282 Default Java 1.7.0_111 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_101 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13756/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13756/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_111.txt JDK v1.7.0_111 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13756/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/13756/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Sample
        JSON

        {
          "apps": {
            "app": [
              {
                "id": "application_1478107292261_0001",
                "user": "root",
                "name": "QuasiMonteCarlo",
                "queue": "default",
                "state": "FINISHED",
                "finalStatus": "SUCCEEDED",
                "progress": 100,
                "trackingUI": "History",
                "trackingUrl": "http://localhost:8088/proxy/application_1478107292261_0001/",
                "diagnostics": "",
                "clusterId": 1478107292261,
                "applicationType": "MAPREDUCE",
                "applicationTags": "",
                "priority": 0,
                "startedTime": 1478107344160,
                "finishedTime": 1478107365065,
                "elapsedTime": 20905,
                "amContainerLogs": "http://localhost:8043/node/containerlogs/container_1478107292261_0001_01_000001/root",
                "amHostHttpAddress": "localhost:8043",
                "amRPCAddress": "localhost:44793",
                "allocatedMB": -1,
                "allocatedVCores": -1,
                "runningContainers": -1,
                "memorySeconds": 51757,
                "vcoreSeconds": 36,
                "queueUsagePercentage": 0,
                "clusterUsagePercentage": 0,
                "preemptedResourceMB": 0,
                "preemptedResourceVCores": 0,
                "numNonAMContainerPreempted": 0,
                "numAMContainerPreempted": 0,
                "logAggregationStatus": "DISABLED",
                "unmanagedApplication": false,
                "amNodeLabelExpression": ""
              }
            ]
          }
        }
        

        XML

        <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
        <apps>
            <app>
                <id>application_1478107292261_0001</id>
                <user>root</user>
                <name>QuasiMonteCarlo</name>
                <queue>default</queue>
                <state>FINISHED</state>
                <finalStatus>SUCCEEDED</finalStatus>
                <progress>100.0</progress>
                <trackingUI>History</trackingUI>
                <trackingUrl>http://localhost:8088/proxy/application_1478107292261_0001/</trackingUrl>
                <diagnostics></diagnostics>
                <clusterId>1478107292261</clusterId>
                <applicationType>MAPREDUCE</applicationType>
                <applicationTags></applicationTags>
                <priority>0</priority>
                <startedTime>1478107344160</startedTime>
                <finishedTime>1478107365065</finishedTime>
                <elapsedTime>20905</elapsedTime>
                <amContainerLogs>http://localhost:8043/node/containerlogs/container_1478107292261_0001_01_000001/root</amContainerLogs>
                <amHostHttpAddress>localhost:8043</amHostHttpAddress>
                <amRPCAddress>localhost:44793</amRPCAddress>
                <allocatedMB>-1</allocatedMB>
                <allocatedVCores>-1</allocatedVCores>
                <runningContainers>-1</runningContainers>
                <memorySeconds>51757</memorySeconds>
                <vcoreSeconds>36</vcoreSeconds>
                <queueUsagePercentage>0.0</queueUsagePercentage>
                <clusterUsagePercentage>0.0</clusterUsagePercentage>
                <preemptedResourceMB>0</preemptedResourceMB>
                <preemptedResourceVCores>0</preemptedResourceVCores>
                <numNonAMContainerPreempted>0</numNonAMContainerPreempted>
                <numAMContainerPreempted>0</numAMContainerPreempted>
                <logAggregationStatus>DISABLED</logAggregationStatus>
                <unmanagedApplication>false</unmanagedApplication>
                <amNodeLabelExpression></amNodeLabelExpression>
            </app>
        </apps>
        
        Show
        bibinchundatt Bibin A Chundatt added a comment - Sample JSON { "apps": { "app": [ { "id": "application_1478107292261_0001", "user": "root", "name": "QuasiMonteCarlo", "queue": "default", "state": "FINISHED", "finalStatus": "SUCCEEDED", "progress": 100, "trackingUI": "History", "trackingUrl": "http://localhost:8088/proxy/application_1478107292261_0001/", "diagnostics": "", "clusterId": 1478107292261, "applicationType": "MAPREDUCE", "applicationTags": "", "priority": 0, "startedTime": 1478107344160, "finishedTime": 1478107365065, "elapsedTime": 20905, "amContainerLogs": "http://localhost:8043/node/containerlogs/container_1478107292261_0001_01_000001/root", "amHostHttpAddress": "localhost:8043", "amRPCAddress": "localhost:44793", "allocatedMB": -1, "allocatedVCores": -1, "runningContainers": -1, "memorySeconds": 51757, "vcoreSeconds": 36, "queueUsagePercentage": 0, "clusterUsagePercentage": 0, "preemptedResourceMB": 0, "preemptedResourceVCores": 0, "numNonAMContainerPreempted": 0, "numAMContainerPreempted": 0, "logAggregationStatus": "DISABLED", "unmanagedApplication": false, "amNodeLabelExpression": "" } ] } } XML <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <apps> <app> <id>application_1478107292261_0001</id> <user>root</user> <name>QuasiMonteCarlo</name> <queue>default</queue> <state>FINISHED</state> <finalStatus>SUCCEEDED</finalStatus> <progress>100.0</progress> <trackingUI>History</trackingUI> <trackingUrl>http://localhost:8088/proxy/application_1478107292261_0001/</trackingUrl> <diagnostics></diagnostics> <clusterId>1478107292261</clusterId> <applicationType>MAPREDUCE</applicationType> <applicationTags></applicationTags> <priority>0</priority> <startedTime>1478107344160</startedTime> <finishedTime>1478107365065</finishedTime> <elapsedTime>20905</elapsedTime> <amContainerLogs>http://localhost:8043/node/containerlogs/container_1478107292261_0001_01_000001/root</amContainerLogs> <amHostHttpAddress>localhost:8043</amHostHttpAddress> <amRPCAddress>localhost:44793</amRPCAddress> <allocatedMB>-1</allocatedMB> <allocatedVCores>-1</allocatedVCores> <runningContainers>-1</runningContainers> <memorySeconds>51757</memorySeconds> <vcoreSeconds>36</vcoreSeconds> <queueUsagePercentage>0.0</queueUsagePercentage> <clusterUsagePercentage>0.0</clusterUsagePercentage> <preemptedResourceMB>0</preemptedResourceMB> <preemptedResourceVCores>0</preemptedResourceVCores> <numNonAMContainerPreempted>0</numNonAMContainerPreempted> <numAMContainerPreempted>0</numAMContainerPreempted> <logAggregationStatus>DISABLED</logAggregationStatus> <unmanagedApplication>false</unmanagedApplication> <amNodeLabelExpression></amNodeLabelExpression> </app> </apps>
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Reattaching patch again to trigger jenkins

        Show
        bibinchundatt Bibin A Chundatt added a comment - Reattaching patch again to trigger jenkins
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 23s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 7m 38s trunk passed
        +1 compile 0m 38s trunk passed
        +1 checkstyle 0m 22s trunk passed
        +1 mvnsite 0m 42s trunk passed
        +1 mvneclipse 0m 17s trunk passed
        +1 findbugs 1m 3s trunk passed
        +1 javadoc 0m 26s trunk passed
        +1 mvninstall 0m 38s the patch passed
        +1 compile 0m 32s the patch passed
        +1 javac 0m 32s the patch passed
        -0 checkstyle 0m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 42 unchanged - 1 fixed = 43 total (was 43)
        +1 mvnsite 0m 35s the patch passed
        +1 mvneclipse 0m 15s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 3s the patch passed
        +1 javadoc 0m 18s the patch passed
        +1 unit 36m 25s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 asflicense 0m 16s The patch does not generate ASF License warnings.
        53m 7s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-4498
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836710/YARN-4498.addendum.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 8ce1c2f760da 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 7e521c5
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13763/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13763/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13763/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 38s trunk passed +1 compile 0m 38s trunk passed +1 checkstyle 0m 22s trunk passed +1 mvnsite 0m 42s trunk passed +1 mvneclipse 0m 17s trunk passed +1 findbugs 1m 3s trunk passed +1 javadoc 0m 26s trunk passed +1 mvninstall 0m 38s the patch passed +1 compile 0m 32s the patch passed +1 javac 0m 32s the patch passed -0 checkstyle 0m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 1 new + 42 unchanged - 1 fixed = 43 total (was 43) +1 mvnsite 0m 35s the patch passed +1 mvneclipse 0m 15s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 3s the patch passed +1 javadoc 0m 18s the patch passed +1 unit 36m 25s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 16s The patch does not generate ASF License warnings. 53m 7s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-4498 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836710/YARN-4498.addendum.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 8ce1c2f760da 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7e521c5 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13763/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13763/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/13763/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks Rohith Sharma K S, as Bibin mentioned we had already discussed and started working towards it!

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks Rohith Sharma K S , as Bibin mentioned we had already discussed and started working towards it!
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks Bibin A Chundatt for sharing the addendum patches, hope you can publish about this issue in the forum, so that others are aware about this difference from 2.8 to trunk due to change in dependent jar version REST can behave differently, but wonder how none of the test fails in the trunk due to it!

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks Bibin A Chundatt for sharing the addendum patches, hope you can publish about this issue in the forum, so that others are aware about this difference from 2.8 to trunk due to change in dependent jar version REST can behave differently, but wonder how none of the test fails in the trunk due to it!
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        I am curious to know what is the inference from this json output? Could you give which field need to be checked?

        Show
        rohithsharma Rohith Sharma K S added a comment - I am curious to know what is the inference from this json output? Could you give which field need to be checked?
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Rohith Sharma K S

        I am curious to know what is the inference from this json output

        As per Latest patch for completed apps.resourceInfo is removed

        Initial implementation new ResourceInfo() was returned when attempt is null ie, Empty ResourcesInfo#resourceUsagesByPartition gets returned.
        In current impl resourceInfo we have set as null. So that for finished apps resourceInfo not required.

        Show
        bibinchundatt Bibin A Chundatt added a comment - Rohith Sharma K S I am curious to know what is the inference from this json output As per Latest patch for completed apps. resourceInfo is removed Initial implementation new ResourceInfo() was returned when attempt is null ie, Empty ResourcesInfo#resourceUsagesByPartition gets returned. In current impl resourceInfo we have set as null. So that for finished apps resourceInfo not required.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        As per the currently implementation at all cases branch and trunk will be in sync for api. Hoping in current patch no changes are required

        Show
        bibinchundatt Bibin A Chundatt added a comment - As per the currently implementation at all cases branch and trunk will be in sync for api. Hoping in current patch no changes are required
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks Bibin A Chundatt, i feel latest approach is fine and i feel i can commit the addendum patches to the specific branch, Rohith Sharma K S any other points on this ?

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks Bibin A Chundatt , i feel latest approach is fine and i feel i can commit the addendum patches to the specific branch, Rohith Sharma K S any other points on this ?
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Rohith Sharma K S, will commit it today if no further comments on the addendum patches

        Show
        Naganarasimha Naganarasimha G R added a comment - Rohith Sharma K S , will commit it today if no further comments on the addendum patches
        Hide
        Naganarasimha Naganarasimha G R added a comment -

        Thanks for the contribution Bibin A Chundatt and additional reviews from Rohith Sharma K S ! Have committed the addendum patches too to trunk, branch-2 & branch-2.8.

        Show
        Naganarasimha Naganarasimha G R added a comment - Thanks for the contribution Bibin A Chundatt and additional reviews from Rohith Sharma K S ! Have committed the addendum patches too to trunk, branch-2 & branch-2.8.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10805 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10805/)
        YARN-4498. Application level node labels stats to be available in REST (naganarasimha_gr: rev edbee9e609e7f31d188660717ff9d3fb9f606abb)

        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10805 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10805/ ) YARN-4498 . Application level node labels stats to be available in REST (naganarasimha_gr: rev edbee9e609e7f31d188660717ff9d3fb9f606abb) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServiceAppsNodelabel.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java

          People

          • Assignee:
            bibinchundatt Bibin A Chundatt
            Reporter:
            bibinchundatt Bibin A Chundatt
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development