Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4106

NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM

      Steps to reproduce
      ===============

      1. Configure nodelabel in distributed mode
        yarn.node-labels.configuration-type=distributed
        provider = config
        yarn.nodemanager.node-labels.provider.fetch-interval-ms=120000ms
      2. Start RM the NM
      3. Once NM is registration is done add nodelabels in RM

      Nodelabels not getting updated in RM side

      This jira also handles the below issue too

      Timer Task not getting triggered in Nodemanager for Label update in nodemanager for distributed scheduling
      Task is supposed to trigger every yarn.nodemanager.node-labels.provider.fetch-interval-ms

      1. 0001-YARN-4106.patch
        1 kB
        Bibin A Chundatt
      2. 0002-YARN-4106.patch
        3 kB
        Bibin A Chundatt
      3. 0003-YARN-4106.patch
        10 kB
        Bibin A Chundatt
      4. 0004-YARN-4106.patch
        10 kB
        Bibin A Chundatt
      5. 0005-YARN-4106.patch
        12 kB
        Bibin A Chundatt
      6. 0006-YARN-4106.patch
        12 kB
        Bibin A Chundatt
      7. 0007-YARN-4106.patch
        12 kB
        Bibin A Chundatt
      8. 0008-YARN-4106.patch
        12 kB
        Bibin A Chundatt

        Issue Links

          Activity

          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Observation
          =========
          Logs shown below are when Cluster node labels are not available in RM

          2015-09-02 10:21:02,766 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Node Labels {1} reported from NM with ID host-<HOSTNAME>:64318 was rejected from RM with exception message as : Not all labels being replaced contained by known label collections,
          please check, new labels=[1]
          
          1. On restart of NM its updating fine
          2. Looks like once failure happens NM not resending nodelabel status in heartbeat to RM
          Show
          bibinchundatt Bibin A Chundatt added a comment - Observation ========= Logs shown below are when Cluster node labels are not available in RM 2015-09-02 10:21:02,766 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Node Labels {1} reported from NM with ID host-<HOSTNAME>:64318 was rejected from RM with exception message as : Not all labels being replaced contained by known label collections, please check, new labels=[1] On restart of NM its updating fine Looks like once failure happens NM not resending nodelabel status in heartbeat to RM
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Thanks for raising this issue Bibin A Chundatt,
          This issue is happening because we are trying to avoid sending labels everytime to RM as if sent everytime RM needs to validate it and refresh the Label mapping for each Node's HB and its a unnecessary overload @ RM side.
          So only in this failure case, wherein the Labels are not accepted by RM then may be we can send the labels as part of each HB (or on periodic intervals) send the labels from NM to RM . Thoughts ? cc/ Wangda Tan

          Show
          Naganarasimha Naganarasimha G R added a comment - Thanks for raising this issue Bibin A Chundatt , This issue is happening because we are trying to avoid sending labels everytime to RM as if sent everytime RM needs to validate it and refresh the Label mapping for each Node's HB and its a unnecessary overload @ RM side. So only in this failure case, wherein the Labels are not accepted by RM then may be we can send the labels as part of each HB (or on periodic intervals) send the labels from NM to RM . Thoughts ? cc/ Wangda Tan
          Hide
          leftnoteasy Wangda Tan added a comment -

          Naganarasimha G R, I think do the sync on periodic intervals seems reasonable to me.

          Maybe we can do this: when a label is not accepted by RM, it will retry every fetch-interval. If a label is accepted by RM, it won't resend unless labels updated in the node.

          Show
          leftnoteasy Wangda Tan added a comment - Naganarasimha G R , I think do the sync on periodic intervals seems reasonable to me. Maybe we can do this: when a label is not accepted by RM, it will retry every fetch-interval. If a label is accepted by RM, it won't resend unless labels updated in the node.
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Thanks for the thoughts Wangda Tan,
          Initially we also thought of the same approach but only thing is: At design level NMDistributedNodeLabelsHandler just asks for labels from provider and AbstractNodeLabelsProvider has the configuration of fetch-interval which periodically fetches the labels using the timer, so design wise would it be better to use the fetch-interval configuration in NMDistributedNodeLabelsHandler for only in the failure case ? or is it good to introduce some new configuration only for failure case here, thoughts ?

          Show
          Naganarasimha Naganarasimha G R added a comment - Thanks for the thoughts Wangda Tan , Initially we also thought of the same approach but only thing is: At design level NMDistributedNodeLabelsHandler just asks for labels from provider and AbstractNodeLabelsProvider has the configuration of fetch-interval which periodically fetches the labels using the timer, so design wise would it be better to use the fetch-interval configuration in NMDistributedNodeLabelsHandler for only in the failure case ? or is it good to introduce some new configuration only for failure case here, thoughts ?
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Hi Wangda Tan & Naganarasimha G R
          Thanks a lot for looking into the issue and suggestion.

          Attaching patch for review.
          In case of failure currently have updared to send at an interval of 1 min
          We can finalize which variable to use for setting.My opinion is DEFAULT_FETCH INTERVAL/3.If new conf need to be added can update too.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Hi Wangda Tan & Naganarasimha G R Thanks a lot for looking into the issue and suggestion. Attaching patch for review. In case of failure currently have updared to send at an interval of 1 min We can finalize which variable to use for setting.My opinion is DEFAULT_FETCH INTERVAL/3 .If new conf need to be added can update too.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Hi Wangda Tan

          Also checking distributed labels further found that Timer task is not getting triggers as expected.

          In ConfigurationNodeLabelsProvider#serviceInit {{startTime }} is getting set wrongly

              if (intervalTime != DISABLE_NODE_LABELS_PROVIDER_FETCH_TIMER) {
                startTime = new Date().getTime() + intervalTime;
              }
          

          Need to remove the same.

          Naganarasimha G R have a look at the same will update patch further after your comments..

          Show
          bibinchundatt Bibin A Chundatt added a comment - Hi Wangda Tan Also checking distributed labels further found that Timer task is not getting triggers as expected. In ConfigurationNodeLabelsProvider#serviceInit {{startTime }} is getting set wrongly if (intervalTime != DISABLE_NODE_LABELS_PROVIDER_FETCH_TIMER) { startTime = new Date().getTime() + intervalTime; } Need to remove the same. Naganarasimha G R have a look at the same will update patch further after your comments..
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Bibin A Chundatt,
          Good catch, Basically this was added initially for testing and later removed but got missed over here so basically its sufficient that intervalTime itself is used as delay in AbstractNodeLabelsProvider.serviceStart and also we can remove startTime & in ConfigurationNodeLabelsProvider.serviceInit we can remove startTime and instead of calling updateNodeLabelsFromConfig in serviceInit we can override and invoke timertask.run in serviceStart(). Please correct the test cases accordingly.

          Show
          Naganarasimha Naganarasimha G R added a comment - Bibin A Chundatt , Good catch, Basically this was added initially for testing and later removed but got missed over here so basically its sufficient that intervalTime itself is used as delay in AbstractNodeLabelsProvider.serviceStart and also we can remove startTime & in ConfigurationNodeLabelsProvider.serviceInit we can remove startTime and instead of calling updateNodeLabelsFromConfig in serviceInit we can override and invoke timertask.run in serviceStart() . Please correct the test cases accordingly.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Naganarasimha G R

          Thnks for comments and suggestion.
          I have updated the patch as per your suggestion.
          Please do review.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Naganarasimha G R Thnks for comments and suggestion. I have updated the patch as per your suggestion. Please do review.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 41s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 59s There were no new javac warning messages.
          +1 javadoc 10m 5s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 0m 37s The applied patch generated 3 new checkstyle issues (total was 38, now 41).
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 1m 14s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 yarn tests 7m 3s Tests failed in hadoop-yarn-server-nodemanager.
              46m 9s  



          Reason Tests
          Failed unit tests hadoop.yarn.server.nodemanager.nodelabels.TestConfigurationNodeLabelsProvider
            hadoop.yarn.server.nodemanager.TestNodeManagerReboot
            hadoop.yarn.server.nodemanager.TestNodeManagerResync
            hadoop.yarn.server.nodemanager.TestNodeStatusUpdaterForLabels



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12754152/0003-YARN-4106.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / c83d13c
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/9007/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9007/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9007/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9007/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 41s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 59s There were no new javac warning messages. +1 javadoc 10m 5s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 37s The applied patch generated 3 new checkstyle issues (total was 38, now 41). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 14s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 7m 3s Tests failed in hadoop-yarn-server-nodemanager.     46m 9s   Reason Tests Failed unit tests hadoop.yarn.server.nodemanager.nodelabels.TestConfigurationNodeLabelsProvider   hadoop.yarn.server.nodemanager.TestNodeManagerReboot   hadoop.yarn.server.nodemanager.TestNodeManagerResync   hadoop.yarn.server.nodemanager.TestNodeStatusUpdaterForLabels Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12754152/0003-YARN-4106.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / c83d13c checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/9007/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9007/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9007/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9007/console This message was automatically generated.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Attaching patch again after checkstyle fix.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Attaching patch again after checkstyle fix.
          Hide
          leftnoteasy Wangda Tan added a comment -

          Bibin A Chundatt,
          Thanks for update,
          Some comments:

          • Not sure if I completely understand the logic. updateNodeLabelsFromConfig of ConfigurationNodeLabelsProvider is invoked only when TimerTask scheduled. And TimerTask of AbstractNodeLabelsProvider delayed started for intervalTime. Does this mean we cannot get labels when initializing ConfigurationNodeLabelsProvider? If so, I think we need to call updateNodeLabelsFromConfig in serviceInit of ConfigurationNodeLabelsProvider. (Another choice is make the delay time from intervalTime to 0, but it runs in another thread, so the behavior is undetermined. To make it simple, I suggest to add it in serviceInit).
          • Add a test for new behavior of this JIRA?
          Show
          leftnoteasy Wangda Tan added a comment - Bibin A Chundatt , Thanks for update, Some comments: Not sure if I completely understand the logic. updateNodeLabelsFromConfig of ConfigurationNodeLabelsProvider is invoked only when TimerTask scheduled. And TimerTask of AbstractNodeLabelsProvider delayed started for intervalTime . Does this mean we cannot get labels when initializing ConfigurationNodeLabelsProvider? If so, I think we need to call updateNodeLabelsFromConfig in serviceInit of ConfigurationNodeLabelsProvider. (Another choice is make the delay time from intervalTime to 0, but it runs in another thread, so the behavior is undetermined. To make it simple, I suggest to add it in serviceInit). Add a test for new behavior of this JIRA?
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Thanks for the comments Wangda Tan,

          Does this mean we cannot get labels when initializing ConfigurationNodeLabelsProvider?

          Actually timerTask.run(); in serviceStart is responsible to fetch the labels for the very first time. Reason for this modification is, if some class extends this in future and forgets to set the labels during the start then it will be missed hence trying to take care of this in AbstractProvider class itself and secondly we cannot choose intervalTime to 0 because there is configuration that timer task need not run at all, so timer itself will not be created in this case, considering all this, he has modified as per the patch.

          Add a test for new behavior of this JIRA

          Well for second issue : i felt changes were related to the design level and scenarios are the same. only thing we have missed is to check whether the timer is triggered after the configured interval and the new labels are set, i think we can have one test case for this. Apart from this were you referring to the test case for first issue also ?

          Show
          Naganarasimha Naganarasimha G R added a comment - Thanks for the comments Wangda Tan , Does this mean we cannot get labels when initializing ConfigurationNodeLabelsProvider? Actually timerTask.run(); in serviceStart is responsible to fetch the labels for the very first time. Reason for this modification is, if some class extends this in future and forgets to set the labels during the start then it will be missed hence trying to take care of this in AbstractProvider class itself and secondly we cannot choose intervalTime to 0 because there is configuration that timer task need not run at all, so timer itself will not be created in this case, considering all this, he has modified as per the patch. Add a test for new behavior of this JIRA Well for second issue : i felt changes were related to the design level and scenarios are the same. only thing we have missed is to check whether the timer is triggered after the configured interval and the new labels are set, i think we can have one test case for this. Apart from this were you referring to the test case for first issue also ?
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Wangda Tan Thnks for looking into the issue and Naganarasimha G R for clearing first point.
          Will try to update testcase for trigger check too. Testcases is working perfectly fine locally for me in eclipse.
          i will recheck and update.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Wangda Tan Thnks for looking into the issue and Naganarasimha G R for clearing first point. Will try to update testcase for trigger check too. Testcases is working perfectly fine locally for me in eclipse. i will recheck and update.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Attaching patch after update of testcase.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Attaching patch after update of testcase.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 9s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 46s There were no new javac warning messages.
          +1 javadoc 10m 12s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 37s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 28s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 1m 13s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 yarn tests 7m 41s Tests failed in hadoop-yarn-server-nodemanager.
              46m 4s  



          Reason Tests
          Timed out tests org.apache.hadoop.yarn.server.nodemanager.TestNodeStatusUpdater



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12754457/0005-YARN-4106.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 1dbd8e3
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9021/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9021/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9021/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 9s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 46s There were no new javac warning messages. +1 javadoc 10m 12s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 37s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 28s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 13s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 7m 41s Tests failed in hadoop-yarn-server-nodemanager.     46m 4s   Reason Tests Timed out tests org.apache.hadoop.yarn.server.nodemanager.TestNodeStatusUpdater Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12754457/0005-YARN-4106.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 1dbd8e3 hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9021/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9021/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9021/console This message was automatically generated.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Ran locally the same testcases its working fine.
          Looks like not related to the patch uploaded.
          Please do review.

          Show
          bibinchundatt Bibin A Chundatt added a comment - Ran locally the same testcases its working fine. Looks like not related to the patch uploaded. Please do review.
          Hide
          leftnoteasy Wangda Tan added a comment -

          Thanks update Bibin A Chundatt, and comments from Naganarasimha G R. Few minor comments:

          1) Make failLabelResendInterval to final before we can configure it.
          2) testConfigTimer sleep time is too much, I don't know if Clock can be used in Timer, I think you can set NM_NODE_LABELS_PROVIDER_FETCH_INTERVAL_MS to lower value, like 1000, and sleep 1500 ms.
          3) With changes in your patch, testNodeLabelsFromConfig doesn't need sleep any more?

          Show
          leftnoteasy Wangda Tan added a comment - Thanks update Bibin A Chundatt , and comments from Naganarasimha G R . Few minor comments: 1) Make failLabelResendInterval to final before we can configure it. 2) testConfigTimer sleep time is too much, I don't know if Clock can be used in Timer, I think you can set NM_NODE_LABELS_PROVIDER_FETCH_INTERVAL_MS to lower value, like 1000, and sleep 1500 ms. 3) With changes in your patch, testNodeLabelsFromConfig doesn't need sleep any more?
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Hi Wangda Tan
          Thnks for comments. Updates patch uploaded

          Show
          bibinchundatt Bibin A Chundatt added a comment - Hi Wangda Tan Thnks for comments. Updates patch uploaded
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 37s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 55s There were no new javac warning messages.
          +1 javadoc 10m 4s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 36s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
          -1 findbugs 1m 15s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings.
          +1 yarn tests 7m 36s Tests passed in hadoop-yarn-server-nodemanager.
              46m 34s  



          Reason Tests
          FindBugs module:hadoop-yarn-server-nodemanager



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12754800/0006-YARN-4106.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / a153b96
          Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/9051/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9051/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9051/testReport/
          Java 1.7.0_55
          uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9051/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 37s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 55s There were no new javac warning messages. +1 javadoc 10m 4s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 36s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. -1 findbugs 1m 15s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings. +1 yarn tests 7m 36s Tests passed in hadoop-yarn-server-nodemanager.     46m 34s   Reason Tests FindBugs module:hadoop-yarn-server-nodemanager Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12754800/0006-YARN-4106.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / a153b96 Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/9051/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9051/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9051/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9051/console This message was automatically generated.
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Findbug report not showing anything looks like build report problem

          Show
          bibinchundatt Bibin A Chundatt added a comment - Findbug report not showing anything looks like build report problem
          Hide
          leftnoteasy Wangda Tan added a comment -

          Bibin A Chundatt, Jenkins cannot show findbugs report properly. You should try to run "mvn clean compile findbugs:findbugs" under nodemanager project, and check target/findbugs.xml.

          Show
          leftnoteasy Wangda Tan added a comment - Bibin A Chundatt , Jenkins cannot show findbugs report properly. You should try to run "mvn clean compile findbugs:findbugs" under nodemanager project, and check target/findbugs.xml.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 40s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 56s There were no new javac warning messages.
          +1 javadoc 10m 5s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 0m 37s The applied patch generated 1 new checkstyle issues (total was 38, now 39).
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 1m 15s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 yarn tests 7m 42s Tests passed in hadoop-yarn-server-nodemanager.
              46m 47s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12755044/0007-YARN-4106.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f153710
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/9073/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9073/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9073/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9073/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 40s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 56s There were no new javac warning messages. +1 javadoc 10m 5s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 37s The applied patch generated 1 new checkstyle issues (total was 38, now 39). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 15s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 7m 42s Tests passed in hadoop-yarn-server-nodemanager.     46m 47s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755044/0007-YARN-4106.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f153710 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/9073/artifact/patchprocess/diffcheckstylehadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9073/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9073/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9073/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          +1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 41s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 8m 2s There were no new javac warning messages.
          +1 javadoc 9m 56s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 36s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 27s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 1m 11s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 yarn tests 7m 34s Tests passed in hadoop-yarn-server-nodemanager.
              46m 26s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12755060/0008-YARN-4106.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f153710
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9074/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9074/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9074/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 41s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 8m 2s There were no new javac warning messages. +1 javadoc 9m 56s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 36s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 1m 11s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 7m 34s Tests passed in hadoop-yarn-server-nodemanager.     46m 26s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755060/0008-YARN-4106.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f153710 hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9074/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9074/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9074/console This message was automatically generated.
          Hide
          leftnoteasy Wangda Tan added a comment -

          +1 to latest patch.

          Show
          leftnoteasy Wangda Tan added a comment - +1 to latest patch.
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          +1, Applied the latest patch, ran the test cases and applied YARN-2729 on top of this patch and script was also running successfully. Latest patch LGTM.
          Wangda Tan As far as this patch its fine but was wondering to increase usability do we need to support YARN-2728, Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup ?

          Show
          Naganarasimha Naganarasimha G R added a comment - +1, Applied the latest patch, ran the test cases and applied YARN-2729 on top of this patch and script was also running successfully. Latest patch LGTM. Wangda Tan As far as this patch its fine but was wondering to increase usability do we need to support YARN-2728 , Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup ?
          Hide
          leftnoteasy Wangda Tan added a comment -

          Committed to trunk/branch-2, thanks Bibin A Chundatt and review from Naganarasimha G R!

          Show
          leftnoteasy Wangda Tan added a comment - Committed to trunk/branch-2, thanks Bibin A Chundatt and review from Naganarasimha G R !
          Hide
          leftnoteasy Wangda Tan added a comment -

          Naganarasimha G R,

          Wangda Tan As far as this patch its fine but was wondering to increase usability do we need to support YARN-2728, Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup ?

          Since we only support node partition, and node partition relates to capacity planning, etc. Without a centralized node partition collection, capacity planning will be not straightforward.

          I think YARN-2728 makes more sense when we support node constraint.

          Show
          leftnoteasy Wangda Tan added a comment - Naganarasimha G R , Wangda Tan As far as this patch its fine but was wondering to increase usability do we need to support YARN-2728 , Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup ? Since we only support node partition, and node partition relates to capacity planning, etc. Without a centralized node partition collection, capacity planning will be not straightforward. I think YARN-2728 makes more sense when we support node constraint.
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Without a centralized node partition collection, capacity planning will be not straightforward.

          yes idea is to still have this collection but only difference being if the labels sent from NM is not present @ RM, then may be Labels Manager can support additional method which adds the missing labels first and then updates the mapping. thoughts?
          Yes it makes more sense when we support node constraint, but if we want to support more flexibility then we can think of supporting this too.

          Show
          Naganarasimha Naganarasimha G R added a comment - Without a centralized node partition collection, capacity planning will be not straightforward. yes idea is to still have this collection but only difference being if the labels sent from NM is not present @ RM, then may be Labels Manager can support additional method which adds the missing labels first and then updates the mapping. thoughts? Yes it makes more sense when we support node constraint, but if we want to support more flexibility then we can think of supporting this too.
          Hide
          leftnoteasy Wangda Tan added a comment -

          ... may be Labels Manager can support additional method which adds the missing labels first and then updates the mapping

          Doing this could be hard to manage: for example, how to deal with node label removal, you can do that when reference count of a label becomes zero, but resource request could be rejected if we remove a existing label. I would not prefer to add more flexibility to node partition, since it will likely break something.

          Show
          leftnoteasy Wangda Tan added a comment - ... may be Labels Manager can support additional method which adds the missing labels first and then updates the mapping Doing this could be hard to manage: for example, how to deal with node label removal, you can do that when reference count of a label becomes zero, but resource request could be rejected if we remove a existing label. I would not prefer to add more flexibility to node partition, since it will likely break something.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8430 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8430/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8430 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8430/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #368 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/368/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #368 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/368/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #374 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/374/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #374 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/374/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1106 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1106/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1106 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1106/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2316 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2316/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2316 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2316/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2293 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2293/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2293 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2293/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #354 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/354/)
          YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #354 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/354/ ) YARN-4106 . NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) (wangda: rev 77666105b4557d5706e5844a4ca286917d966c5f) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/ConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/AbstractNodeLabelsProvider.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/nodelabels/TestConfigurationNodeLabelsProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java

            People

            • Assignee:
              bibinchundatt Bibin A Chundatt
              Reporter:
              bibinchundatt Bibin A Chundatt
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development