Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5029

RM needs to send update event with YarnApplicationState as Running to ATS/AHS

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Right now, Application in AHS/ATS is alway in ACCEPTED state until the application finishes/Fails/is killed. This is because RM did not send any other YarnApplicationState information, except FINISHED/FAILED/KILLED, to ATS.

      1. YARN-5029.1.patch
        16 kB
        Xuan Gong
      2. YARN-5029.2.patch
        19 kB
        Xuan Gong

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 10s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 11s Maven dependency ordering for branch
        +1 mvninstall 6m 44s trunk passed
        +1 compile 1m 5s trunk passed with JDK v1.8.0_91
        +1 compile 1m 16s trunk passed with JDK v1.7.0_95
        +1 checkstyle 0m 27s trunk passed
        +1 mvnsite 1m 20s trunk passed
        +1 mvneclipse 0m 41s trunk passed
        -1 findbugs 0m 43s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common in trunk has 3 extant Findbugs warnings.
        +1 javadoc 0m 52s trunk passed with JDK v1.8.0_91
        +1 javadoc 1m 7s trunk passed with JDK v1.7.0_95
        0 mvndep 0m 9s Maven dependency ordering for patch
        +1 mvninstall 1m 6s the patch passed
        +1 compile 1m 1s the patch passed with JDK v1.8.0_91
        +1 javac 1m 1s the patch passed
        +1 compile 1m 14s the patch passed with JDK v1.7.0_95
        +1 javac 1m 14s the patch passed
        -1 checkstyle 0m 24s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server: patch generated 7 new + 204 unchanged - 1 fixed = 211 total (was 205)
        +1 mvnsite 1m 13s the patch passed
        +1 mvneclipse 0m 35s the patch passed
        -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
        +1 findbugs 2m 53s the patch passed
        +1 javadoc 0m 46s the patch passed with JDK v1.8.0_91
        +1 javadoc 1m 1s the patch passed with JDK v1.7.0_95
        +1 unit 0m 20s hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91.
        +1 unit 2m 53s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_91.
        -1 unit 28m 43s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91.
        +1 unit 0m 24s hadoop-yarn-server-common in the patch passed with JDK v1.7.0_95.
        +1 unit 3m 11s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_95.
        -1 unit 29m 54s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95.
        +1 asflicense 0m 21s Patch does not generate ASF License warnings.
        93m 45s



        Reason Tests
        JDK v1.8.0_91 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestContainerResourceUsage
          hadoop.yarn.server.resourcemanager.TestAMAuthorization
        JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher
          hadoop.yarn.server.resourcemanager.TestAMAuthorization



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:cf2ee45
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12802267/YARN-5029.1.patch
        JIRA Issue YARN-5029
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 2709cf440599 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 7bd418e
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common-warnings.html
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server.txt
        whitespace https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/whitespace-tabs.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11336/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/11336/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 11s Maven dependency ordering for branch +1 mvninstall 6m 44s trunk passed +1 compile 1m 5s trunk passed with JDK v1.8.0_91 +1 compile 1m 16s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 27s trunk passed +1 mvnsite 1m 20s trunk passed +1 mvneclipse 0m 41s trunk passed -1 findbugs 0m 43s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common in trunk has 3 extant Findbugs warnings. +1 javadoc 0m 52s trunk passed with JDK v1.8.0_91 +1 javadoc 1m 7s trunk passed with JDK v1.7.0_95 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 1m 6s the patch passed +1 compile 1m 1s the patch passed with JDK v1.8.0_91 +1 javac 1m 1s the patch passed +1 compile 1m 14s the patch passed with JDK v1.7.0_95 +1 javac 1m 14s the patch passed -1 checkstyle 0m 24s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server: patch generated 7 new + 204 unchanged - 1 fixed = 211 total (was 205) +1 mvnsite 1m 13s the patch passed +1 mvneclipse 0m 35s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 findbugs 2m 53s the patch passed +1 javadoc 0m 46s the patch passed with JDK v1.8.0_91 +1 javadoc 1m 1s the patch passed with JDK v1.7.0_95 +1 unit 0m 20s hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91. +1 unit 2m 53s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_91. -1 unit 28m 43s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91. +1 unit 0m 24s hadoop-yarn-server-common in the patch passed with JDK v1.7.0_95. +1 unit 3m 11s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_95. -1 unit 29m 54s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 21s Patch does not generate ASF License warnings. 93m 45s Reason Tests JDK v1.8.0_91 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestContainerResourceUsage   hadoop.yarn.server.resourcemanager.TestAMAuthorization JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher   hadoop.yarn.server.resourcemanager.TestAMAuthorization Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12802267/YARN-5029.1.patch JIRA Issue YARN-5029 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 2709cf440599 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7bd418e Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/11336/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11336/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server Console output https://builds.apache.org/job/PreCommit-YARN-Build/11336/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        djp Junping Du added a comment -

        Thanks Xuan Gong for reporting the issue and putting up a patch. The patch looks good in overall. However, I see we have UT for TestSystemMetricsPublisher to check if SystemMetricsPublisher received the event. It would be helpful to have an additional check in ATS side to actually see event is written in backend - just like what we have now in TestDistributedShell.
        Also, there are several indentation issues in v1 patch that we should fix.
        Other looks fine.

        Show
        djp Junping Du added a comment - Thanks Xuan Gong for reporting the issue and putting up a patch. The patch looks good in overall. However, I see we have UT for TestSystemMetricsPublisher to check if SystemMetricsPublisher received the event. It would be helpful to have an additional check in ATS side to actually see event is written in backend - just like what we have now in TestDistributedShell. Also, there are several indentation issues in v1 patch that we should fix. Other looks fine.
        Hide
        xgong Xuan Gong added a comment -

        Thanks for the review. Junping.

        Uploaded a new patch to fix checkstyle issue and testcase failure.

        TestSystemMetricsPublisher to check if SystemMetricsPublisher received the event. It would be helpful to have an additional check in ATS side to actually see event is written in backend - just like what we have now in TestDistributedShell.

        It actually did the check. After SystemMetricsPublisher sends all the events, we do the getEntity call from ATS and check whether we have those events as well as specified data.

        Show
        xgong Xuan Gong added a comment - Thanks for the review. Junping. Uploaded a new patch to fix checkstyle issue and testcase failure. TestSystemMetricsPublisher to check if SystemMetricsPublisher received the event. It would be helpful to have an additional check in ATS side to actually see event is written in backend - just like what we have now in TestDistributedShell. It actually did the check. After SystemMetricsPublisher sends all the events, we do the getEntity call from ATS and check whether we have those events as well as specified data.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 12s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 11s Maven dependency ordering for branch
        +1 mvninstall 6m 47s trunk passed
        +1 compile 1m 10s trunk passed with JDK v1.8.0_91
        +1 compile 1m 18s trunk passed with JDK v1.7.0_95
        +1 checkstyle 0m 29s trunk passed
        +1 mvnsite 1m 21s trunk passed
        +1 mvneclipse 0m 42s trunk passed
        -1 findbugs 0m 44s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common in trunk has 3 extant Findbugs warnings.
        +1 javadoc 0m 57s trunk passed with JDK v1.8.0_91
        +1 javadoc 1m 9s trunk passed with JDK v1.7.0_95
        0 mvndep 0m 9s Maven dependency ordering for patch
        +1 mvninstall 1m 7s the patch passed
        +1 compile 1m 4s the patch passed with JDK v1.8.0_91
        +1 javac 1m 4s the patch passed
        +1 compile 1m 16s the patch passed with JDK v1.7.0_95
        +1 javac 1m 16s the patch passed
        -1 checkstyle 0m 25s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server: patch generated 1 new + 178 unchanged - 27 fixed = 179 total (was 205)
        +1 mvnsite 1m 13s the patch passed
        +1 mvneclipse 0m 36s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 59s the patch passed
        +1 javadoc 0m 51s the patch passed with JDK v1.8.0_91
        +1 javadoc 1m 3s the patch passed with JDK v1.7.0_95
        +1 unit 0m 21s hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91.
        +1 unit 2m 56s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_91.
        -1 unit 30m 5s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91.
        +1 unit 0m 25s hadoop-yarn-server-common in the patch passed with JDK v1.7.0_95.
        +1 unit 3m 10s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_95.
        -1 unit 30m 47s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95.
        +1 asflicense 0m 20s Patch does not generate ASF License warnings.
        96m 52s



        Reason Tests
        JDK v1.8.0_91 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestRMRestart
          hadoop.yarn.server.resourcemanager.TestContainerResourceUsage
          hadoop.yarn.server.resourcemanager.TestAMAuthorization
        JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestRMRestart
          hadoop.yarn.server.resourcemanager.TestAMAuthorization



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:cf2ee45
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12802565/YARN-5029.2.patch
        JIRA Issue YARN-5029
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 9cacfd5f294e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / f305d9c
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common-warnings.html
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11352/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/11352/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 11s Maven dependency ordering for branch +1 mvninstall 6m 47s trunk passed +1 compile 1m 10s trunk passed with JDK v1.8.0_91 +1 compile 1m 18s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 29s trunk passed +1 mvnsite 1m 21s trunk passed +1 mvneclipse 0m 42s trunk passed -1 findbugs 0m 44s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common in trunk has 3 extant Findbugs warnings. +1 javadoc 0m 57s trunk passed with JDK v1.8.0_91 +1 javadoc 1m 9s trunk passed with JDK v1.7.0_95 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 1m 7s the patch passed +1 compile 1m 4s the patch passed with JDK v1.8.0_91 +1 javac 1m 4s the patch passed +1 compile 1m 16s the patch passed with JDK v1.7.0_95 +1 javac 1m 16s the patch passed -1 checkstyle 0m 25s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server: patch generated 1 new + 178 unchanged - 27 fixed = 179 total (was 205) +1 mvnsite 1m 13s the patch passed +1 mvneclipse 0m 36s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 59s the patch passed +1 javadoc 0m 51s the patch passed with JDK v1.8.0_91 +1 javadoc 1m 3s the patch passed with JDK v1.7.0_95 +1 unit 0m 21s hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91. +1 unit 2m 56s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_91. -1 unit 30m 5s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91. +1 unit 0m 25s hadoop-yarn-server-common in the patch passed with JDK v1.7.0_95. +1 unit 3m 10s hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_95. -1 unit 30m 47s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 20s Patch does not generate ASF License warnings. 96m 52s Reason Tests JDK v1.8.0_91 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.TestContainerResourceUsage   hadoop.yarn.server.resourcemanager.TestAMAuthorization JDK v1.7.0_95 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.TestAMAuthorization Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12802565/YARN-5029.2.patch JIRA Issue YARN-5029 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 9cacfd5f294e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / f305d9c Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/11352/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/11352/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server Console output https://builds.apache.org/job/PreCommit-YARN-Build/11352/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        djp Junping Du added a comment -

        02 patch LGTM. The UT failures are not related to the patch and we already have plenty of JIRAs to track them. Findbugs warning and check-style issue are also legacy issue of existing code base. +1. Will commit it shortly if no further comments.

        Show
        djp Junping Du added a comment - 02 patch LGTM. The UT failures are not related to the patch and we already have plenty of JIRAs to track them. Findbugs warning and check-style issue are also legacy issue of existing code base. +1. Will commit it shortly if no further comments.
        Hide
        djp Junping Du added a comment -

        I have commit the patch to trunk, branch-2 and branch-2.8. Thanks Xuan Gong for the patch contribution!

        Show
        djp Junping Du added a comment - I have commit the patch to trunk, branch-2 and branch-2.8. Thanks Xuan Gong for the patch contribution!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #9746 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9746/)
        YARN-5029. RM needs to send update event with YarnApplicationState as (junping_du: rev 39f2bac38b111f90d3402229201cdb4315f5d4f5)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicaitonStateUpdatedEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9746 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9746/ ) YARN-5029 . RM needs to send update event with YarnApplicationState as (junping_du: rev 39f2bac38b111f90d3402229201cdb4315f5d4f5) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicaitonStateUpdatedEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java

          People

          • Assignee:
            xgong Xuan Gong
            Reporter:
            xgong Xuan Gong
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development