Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3965

Add startup timestamp to nodemanager UI

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We have startup timestamp for RM already, but don't for NM.
      Sometimes cluster operator modified configuration of all nodes and kicked off command to restart all NMs. He found out it's hard for him to check whether all NMs are restarted. Actually there's always some NMs didn't restart as he expected, which leads to some error later due to inconsistent configuration.

      If we have startup timestamp for NM, the operator could easily fetch it via NM webservice and find out which NM didn't restart, and take mannaul action for it.

      1. YARN-3965.patch
        4 kB
        Hong Zhiguo
      2. YARN-3965-2.patch
        6 kB
        Hong Zhiguo
      3. YARN-3965-3.patch
        6 kB
        Hong Zhiguo
      4. YARN-3965-4.patch
        6 kB
        Hong Zhiguo

        Activity

        Hide
        aw Allen Wittenauer added a comment -

        If we have startup timestamp for NM, the operator could easily fetch it via NM webservice and find out which NM didn't restart, and take mannaul action for it.

        That's an operational anti-pattern: polling thousands of machines like this won't scale. The RM should be able to report when various NMs joined the system.

        Show
        aw Allen Wittenauer added a comment - If we have startup timestamp for NM, the operator could easily fetch it via NM webservice and find out which NM didn't restart, and take mannaul action for it. That's an operational anti-pattern: polling thousands of machines like this won't scale. The RM should be able to report when various NMs joined the system.
        Hide
        jlowe Jason Lowe added a comment -

        This still has utility outside of a massive polling script. The NM provides a web UI just like the other daemons, reporting what hadoop version it's running, when it last health reported, etc. The startup time is conspicuously missing compared to similar About pages on other Hadoop daemons.

        Also this is not quite the same concept as when an NM joined the RM. An NM can join the RM multiple times since it started, and sometimes one would like to know when the NM process itself launched. Sure, if one has access they can login to the node and figure it out from the OS, but it can be convenient to report it on the nodemanager UI as well.

        Show
        jlowe Jason Lowe added a comment - This still has utility outside of a massive polling script. The NM provides a web UI just like the other daemons, reporting what hadoop version it's running, when it last health reported, etc. The startup time is conspicuously missing compared to similar About pages on other Hadoop daemons. Also this is not quite the same concept as when an NM joined the RM. An NM can join the RM multiple times since it started, and sometimes one would like to know when the NM process itself launched. Sure, if one has access they can login to the node and figure it out from the OS, but it can be convenient to report it on the nodemanager UI as well.
        Hide
        zhiguohong Hong Zhiguo added a comment -

        The polling doesn't need to happen frequently. Only when the operator NM upgrade or NM configuration change.

        Show
        zhiguohong Hong Zhiguo added a comment - The polling doesn't need to happen frequently. Only when the operator NM upgrade or NM configuration change.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 16m 41s Findbugs (version ) appears to be broken on trunk.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 8m 33s There were no new javac warning messages.
        +1 javadoc 10m 21s There were no new javadoc warning messages.
        +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
        +1 checkstyle 0m 22s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 27s mvn install still works.
        +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
        +1 findbugs 1m 24s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 6m 9s Tests failed in hadoop-yarn-server-nodemanager.
            45m 58s  



        Reason Tests
        Failed unit tests hadoop.yarn.server.nodemanager.webapp.TestNMWebServices



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12746994/YARN-3965.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 206d493
        hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8648/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8648/testReport/
        Java 1.7.0_55
        uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8648/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 16m 41s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 33s There were no new javac warning messages. +1 javadoc 10m 21s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 22s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 1m 24s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 6m 9s Tests failed in hadoop-yarn-server-nodemanager.     45m 58s   Reason Tests Failed unit tests hadoop.yarn.server.nodemanager.webapp.TestNMWebServices Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12746994/YARN-3965.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 206d493 hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8648/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8648/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8648/console This message was automatically generated.
        Hide
        zhiguohong Hong Zhiguo added a comment -

        The first patch breaks TestNMWebServices.verifyNodeInfo. Corrected in this one.

        Show
        zhiguohong Hong Zhiguo added a comment - The first patch breaks TestNMWebServices.verifyNodeInfo. Corrected in this one.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 15m 16s Findbugs (version ) appears to be broken on trunk.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 47s There were no new javac warning messages.
        +1 javadoc 9m 48s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        +1 checkstyle 0m 20s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 21s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 findbugs 1m 13s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 yarn tests 6m 8s Tests passed in hadoop-yarn-server-nodemanager.
            42m 53s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12747026/YARN-3965-2.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 206d493
        hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8650/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8650/testReport/
        Java 1.7.0_55
        uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8650/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 15m 16s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 47s There were no new javac warning messages. +1 javadoc 9m 48s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 20s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 21s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 13s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 6m 8s Tests passed in hadoop-yarn-server-nodemanager.     42m 53s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12747026/YARN-3965-2.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 206d493 hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8650/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8650/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8650/console This message was automatically generated.
        Hide
        zxu zhihai xu added a comment -

        Hi Hong Zhiguo, thanks for the patch.

        1. Can we make nmStartupTime non-static? since we will only have one NodeManager instance, using static won't save much memory. Using non-static may be easier to write test/simulation in the future. For example, we can create two NM in the test/simulation, compare their start time are different.
        2. Can we change the scope for NodeManager#nmStartupTime to private and create a public method to read it? So nmStartupTime won't be changed outside NodeManager accidentally.
        Show
        zxu zhihai xu added a comment - Hi Hong Zhiguo , thanks for the patch. Can we make nmStartupTime non-static? since we will only have one NodeManager instance, using static won't save much memory. Using non-static may be easier to write test/simulation in the future. For example, we can create two NM in the test/simulation, compare their start time are different. Can we change the scope for NodeManager#nmStartupTime to private and create a public method to read it? So nmStartupTime won't be changed outside NodeManager accidentally.
        Hide
        zhiguohong Hong Zhiguo added a comment -

        Hi, zhihai xu, thanks for your comments. Here comes my re-consideration.

        1. The nmStartupTime could be non-statice field of NodeManager, but it make it harder to access it since the accesser must have a reference to the NodeManager instance. For example, there's no such reference in current implementaion of NodeInfo constructor. One option is to make nmStartupTime as a non-static filed of NMContext. But I doubt is it worth to make simple thing complecated. BTW, the startup timestampt of ResourceManager is also static.

        2. It's "final" so don't need warry about that. Private field with a Getter is also OK if you think it's better.

        Show
        zhiguohong Hong Zhiguo added a comment - Hi, zhihai xu , thanks for your comments. Here comes my re-consideration. 1. The nmStartupTime could be non-statice field of NodeManager, but it make it harder to access it since the accesser must have a reference to the NodeManager instance. For example, there's no such reference in current implementaion of NodeInfo constructor. One option is to make nmStartupTime as a non-static filed of NMContext. But I doubt is it worth to make simple thing complecated. BTW, the startup timestampt of ResourceManager is also static. 2. It's "final" so don't need warry about that. Private field with a Getter is also OK if you think it's better.
        Hide
        zxu zhihai xu added a comment -

        thanks for the explanation Hong Zhiguo!

        One option is to make nmStartupTime as a non-static filed of NMContext. But I doubt is it worth to make simple thing complecated. BTW, the startup timestampt of ResourceManager is also static.

        Thanks for the information, Since time stamp of ResourceManager is also static, I am ok to use static. In practice, there is only one active RM and many active NMs. Adding nmStartupTime to NMContext is not bad, which can provide more information about the NM in the context. So either static or non-static is ok to me. Let's see what other people's opinions are.
        If we use static, Can we add an API to get the time stamp for NM similar as ResourceManager.getClusterTimeStamp for RM?

        It's "final" so don't need warry about that

        Yes, you are right. I missed "final" keywords

        Show
        zxu zhihai xu added a comment - thanks for the explanation Hong Zhiguo ! One option is to make nmStartupTime as a non-static filed of NMContext. But I doubt is it worth to make simple thing complecated. BTW, the startup timestampt of ResourceManager is also static. Thanks for the information, Since time stamp of ResourceManager is also static, I am ok to use static. In practice, there is only one active RM and many active NMs. Adding nmStartupTime to NMContext is not bad, which can provide more information about the NM in the context. So either static or non-static is ok to me. Let's see what other people's opinions are. If we use static, Can we add an API to get the time stamp for NM similar as ResourceManager.getClusterTimeStamp for RM? It's "final" so don't need warry about that Yes, you are right. I missed "final" keywords
        Hide
        zhiguohong Hong Zhiguo added a comment -

        made it private with Getter.
        Hi, zhihai xu, Jason Lowe, could please review the patch?

        Show
        zhiguohong Hong Zhiguo added a comment - made it private with Getter. Hi, zhihai xu , Jason Lowe , could please review the patch?
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 17m 2s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 8m 16s There were no new javac warning messages.
        +1 javadoc 10m 19s There were no new javadoc warning messages.
        +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 41s The applied patch generated 2 new checkstyle issues (total was 46, now 48).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 24s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 1m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 yarn tests 6m 14s Tests passed in hadoop-yarn-server-nodemanager.
            46m 16s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12747995/YARN-3965-3.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / ddc867ce
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8715/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt
        hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8715/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8715/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8715/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 2s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 8m 16s There were no new javac warning messages. +1 javadoc 10m 19s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 41s The applied patch generated 2 new checkstyle issues (total was 46, now 48). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 24s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 6m 14s Tests passed in hadoop-yarn-server-nodemanager.     46m 16s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12747995/YARN-3965-3.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / ddc867ce checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8715/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8715/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8715/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8715/console This message was automatically generated.
        Hide
        jlowe Jason Lowe added a comment -

        Looks good overall with one minor nit: the patch is not consistent about getNMStartupTime vs getNmStartupTime.

        Show
        jlowe Jason Lowe added a comment - Looks good overall with one minor nit: the patch is not consistent about getNMStartupTime vs getNmStartupTime.
        Hide
        zhiguohong Hong Zhiguo added a comment -

        Hi, Jason Lowe, version 4 of the patch is uploaded with 2 changes:
        1) NodeInfo.getNmStartupTime -> NodeInfo.getNMStartupTime
        2) removed the "final" qualifier on NodeManager.nmStartupTime to avoid checkstyle error:

           Name 'nmStartupTime' must match pattern '^[A-Z][A-Z0-9]*(_[A-Z0-9]+)*$'
           

        It's private with Getter. So it's OK not to be final.

        Show
        zhiguohong Hong Zhiguo added a comment - Hi, Jason Lowe , version 4 of the patch is uploaded with 2 changes: 1) NodeInfo.getNmStartupTime -> NodeInfo.getNMStartupTime 2) removed the "final" qualifier on NodeManager.nmStartupTime to avoid checkstyle error: Name 'nmStartupTime' must match pattern '^[A-Z][A-Z0-9]*(_[A-Z0-9]+)*$' It's private with Getter. So it's OK not to be final.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 16m 6s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 48s There were no new javac warning messages.
        +1 javadoc 9m 46s There were no new javadoc warning messages.
        +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 37s The applied patch generated 1 new checkstyle issues (total was 47, now 48).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 22s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 findbugs 1m 14s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 6m 8s Tests failed in hadoop-yarn-server-nodemanager.
            44m 1s  



        Reason Tests
        Failed unit tests hadoop.yarn.server.nodemanager.TestDeletionService



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12748110/YARN-3965-4.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 88d8736
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8729/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt
        hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8729/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8729/testReport/
        Java 1.7.0_55
        uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8729/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 6s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 48s There were no new javac warning messages. +1 javadoc 9m 46s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 37s The applied patch generated 1 new checkstyle issues (total was 47, now 48). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 22s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 14s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 6m 8s Tests failed in hadoop-yarn-server-nodemanager.     44m 1s   Reason Tests Failed unit tests hadoop.yarn.server.nodemanager.TestDeletionService Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12748110/YARN-3965-4.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 88d8736 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8729/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8729/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8729/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8729/console This message was automatically generated.
        Hide
        jlowe Jason Lowe added a comment -

        Test failure is unrelated and has recently been failing for other test-patch runs. Filed YARN-4010.

        +1 lgtm. Committing this.

        Show
        jlowe Jason Lowe added a comment - Test failure is unrelated and has recently been failing for other test-patch runs. Filed YARN-4010 . +1 lgtm. Committing this.
        Hide
        jlowe Jason Lowe added a comment -

        Thanks to Hong for the contribution and to zhihai for additional review! I committed this to trunk and branch-2.

        Show
        jlowe Jason Lowe added a comment - Thanks to Hong for the contribution and to zhihai for additional review! I committed this to trunk and branch-2.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8256 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8256/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8256 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8256/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #277 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/277/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #277 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/277/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #1007 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1007/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1007 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1007/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2204 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2204/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2204 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2204/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2223 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2223/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2223 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2223/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #266 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/266/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #266 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/266/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #274 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/274/)
        YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #274 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/274/ ) YARN-3965 . Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo (jlowe: rev 469cfcd695da979e56c83d9303f9bc1f898c08ce) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/NodePage.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NodeInfo.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java

          People

          • Assignee:
            zhiguohong Hong Zhiguo
            Reporter:
            zhiguohong Hong Zhiguo
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development