Details

    • Hadoop Flags:
      Reviewed
    • Flags:
      Patch

      Description

      In this JIRA we propose to collect the network usage on a node. This JIRA is part of a larger effort of monitoring resource usages on the nodes.

      1. YARN-3819-5.patch
        16 kB
        Robert Grandl
      2. YARN-3819-4.patch
        16 kB
        Robert Grandl
      3. YARN-3819-3.patch
        14 kB
        Robert Grandl
      4. YARN-3819-2.patch
        13 kB
        Robert Grandl
      5. YARN-3819-1.patch
        12 kB
        Robert Grandl
      6. HADOOP-12210.000.patch
        14 kB
        Chris Douglas

        Issue Links

          Activity

          Hide
          rgrandl Robert Grandl added a comment -

          Attach a first cut patch

          Show
          rgrandl Robert Grandl added a comment - Attach a first cut patch
          Hide
          rgrandl Robert Grandl added a comment -

          Srikanth Kandula and I were proposing to collect the network usage on a node. This is part of a larger effort of multi-resource scheduling. Previous efforts in collecting network usage per containers is not enough for the purpose of multi-resource scheduling, as it is not able to capture other traffic activities on the node such as ingestion or evacuation.

          Show
          rgrandl Robert Grandl added a comment - Srikanth Kandula and I were proposing to collect the network usage on a node. This is part of a larger effort of multi-resource scheduling. Previous efforts in collecting network usage per containers is not enough for the purpose of multi-resource scheduling, as it is not able to capture other traffic activities on the node such as ingestion or evacuation.
          Hide
          rgrandl Robert Grandl added a comment -

          Updates to DummyResourceCalculatorPlugin.java

          Show
          rgrandl Robert Grandl added a comment - Updates to DummyResourceCalculatorPlugin.java
          Hide
          grey Lei Guo added a comment -

          For multiple resource scheduling, we may have different resource types, not just CPU/disk/network. Even for network, we may need other attributes instead of just read and write. It's better to have some generic framework in RM/NM and collect data via plug-ins.

          Show
          grey Lei Guo added a comment - For multiple resource scheduling, we may have different resource types, not just CPU/disk/network. Even for network, we may need other attributes instead of just read and write. It's better to have some generic framework in RM/NM and collect data via plug-ins.
          Hide
          rgrandl Robert Grandl added a comment -

          Lei Guo, YARN-2745 is an effort to schedule multiple resources. The resources taken in account are CPU/Memory/Disk/Network. For fungible resources such as disk and network, the counters required are the total number of bytes read/written from/to disk/network.

          This JIRA extends the ResourceCalculatorPlugin which is able to extract the amount of available CPU and Memory on a node. YARN-1012 is already using this information and YARN-1012 is aggregating this information in a heartbeat from NM to RM.

          Show
          rgrandl Robert Grandl added a comment - Lei Guo , YARN-2745 is an effort to schedule multiple resources. The resources taken in account are CPU/Memory/Disk/Network. For fungible resources such as disk and network, the counters required are the total number of bytes read/written from/to disk/network. This JIRA extends the ResourceCalculatorPlugin which is able to extract the amount of available CPU and Memory on a node. YARN-1012 is already using this information and YARN-1012 is aggregating this information in a heartbeat from NM to RM.
          Hide
          rgrandl Robert Grandl added a comment -

          Short description of this JIRA:
          We process "/proc/net/dev" file which reports for every network interface present on the node, the cumulative amount of bytes read/written. We aggregate these numbers across all the interfaces except loopback.

          We tested the existence of these files in the following Linux kernel versions:
          Linux 3.2.0
          Linux 2.6.32
          Linux 3.13.0

          Also, doing further search on the web, it seems people are using/recommending these files for extracting read/written network bytes counters.

          Show
          rgrandl Robert Grandl added a comment - Short description of this JIRA: We process "/proc/net/dev" file which reports for every network interface present on the node, the cumulative amount of bytes read/written. We aggregate these numbers across all the interfaces except loopback. We tested the existence of these files in the following Linux kernel versions: Linux 3.2.0 Linux 2.6.32 Linux 3.13.0 Also, doing further search on the web, it seems people are using/recommending these files for extracting read/written network bytes counters.
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          Lei Guo The patch does have the generic component, in that it needs /proc/net... It would be possible to expose whatever additional fields end up being needed by schedulers or monitors. We only expose a first cut of them (total read/ written).

          Show
          srikanthkandula Srikanth Kandula added a comment - Lei Guo The patch does have the generic component, in that it needs /proc/net... It would be possible to expose whatever additional fields end up being needed by schedulers or monitors. We only expose a first cut of them (total read/ written).
          Hide
          grey Lei Guo added a comment -

          Thanks for the explanation. My concern is mainly about we will need update the code when we need new resource information for scheduling purpose. If we have a generic framework, and the integration developer may can write a script to feed information into NM, and then RM can do scheduling based on that, this is part of my comment in 3332,

          https://issues.apache.org/jira/browse/YARN-3332?focusedCommentId=14355923&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14355923

          Show
          grey Lei Guo added a comment - Thanks for the explanation. My concern is mainly about we will need update the code when we need new resource information for scheduling purpose. If we have a generic framework, and the integration developer may can write a script to feed information into NM, and then RM can do scheduling based on that, this is part of my comment in 3332, https://issues.apache.org/jira/browse/YARN-3332?focusedCommentId=14355923&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14355923
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 17m 4s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          -1 javac 3m 3s The patch appears to cause the build to fail.



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740201/YARN-3819-3.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / cc43288
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8274/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 4s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. -1 javac 3m 3s The patch appears to cause the build to fail. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740201/YARN-3819-3.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / cc43288 Console output https://builds.apache.org/job/PreCommit-YARN-Build/8274/console This message was automatically generated.
          Hide
          rgrandl Robert Grandl added a comment -

          Updated patch to address the failure and the whitespaces

          Show
          rgrandl Robert Grandl added a comment - Updated patch to address the failure and the whitespaces
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 17m 54s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 38s There were no new javac warning messages.
          +1 javadoc 9m 46s There were no new javadoc warning messages.
          +1 release audit 0m 21s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 35s The applied patch generated 7 new checkstyle issues (total was 15, now 22).
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 3m 38s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 tools/hadoop tests 16m 20s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.
          +1 yarn tests 6m 5s Tests passed in hadoop-yarn-server-nodemanager.
              67m 37s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740281/YARN-3819-4.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 74351af
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8275/testReport/
          Java 1.7.0_55
          uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8275/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 54s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 38s There were no new javac warning messages. +1 javadoc 9m 46s There were no new javadoc warning messages. +1 release audit 0m 21s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 35s The applied patch generated 7 new checkstyle issues (total was 15, now 22). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 3m 38s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 tools/hadoop tests 16m 20s Tests passed in hadoop-gridmix. +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common. +1 yarn tests 6m 5s Tests passed in hadoop-yarn-server-nodemanager.     67m 37s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740281/YARN-3819-4.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 74351af checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-yarn-common.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8275/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8275/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8275/console This message was automatically generated.
          Hide
          rgrandl Robert Grandl added a comment -

          Fixed checkstyle issues.

          Show
          rgrandl Robert Grandl added a comment - Fixed checkstyle issues.
          Hide
          hadoopqa Hadoop QA added a comment -



          +1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 18m 13s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 43s There were no new javac warning messages.
          +1 javadoc 9m 57s There were no new javadoc warning messages.
          +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 52s There were no new checkstyle issues.
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 3m 36s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 tools/hadoop tests 16m 27s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.
          +1 yarn tests 6m 19s Tests passed in hadoop-yarn-server-nodemanager.
              68m 40s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740322/YARN-3819-5.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 295d678
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8283/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8283/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 13s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 43s There were no new javac warning messages. +1 javadoc 9m 57s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 52s There were no new checkstyle issues. +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 3m 36s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 tools/hadoop tests 16m 27s Tests passed in hadoop-gridmix. +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common. +1 yarn tests 6m 19s Tests passed in hadoop-yarn-server-nodemanager.     68m 40s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740322/YARN-3819-5.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 295d678 hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-yarn-common.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8283/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8283/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8283/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          +1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 18m 30s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 49s There were no new javac warning messages.
          +1 javadoc 9m 53s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 48s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 35s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 3m 39s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 tools/hadoop tests 16m 34s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.
          +1 yarn tests 6m 32s Tests passed in hadoop-yarn-server-nodemanager.
              69m 18s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740322/YARN-3819-5.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 1c13519
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8284/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8284/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 30s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 49s There were no new javac warning messages. +1 javadoc 9m 53s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 48s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 35s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 3m 39s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 tools/hadoop tests 16m 34s Tests passed in hadoop-gridmix. +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common. +1 yarn tests 6m 32s Tests passed in hadoop-yarn-server-nodemanager.     69m 18s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740322/YARN-3819-5.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 1c13519 hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-yarn-common.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8284/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8284/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8284/console This message was automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -1

          This needs to go into common. I don't know how much more obvious it should be that HDFS will at some point to collect this data too for its usage.

          Show
          aw Allen Wittenauer added a comment - -1 This needs to go into common. I don't know how much more obvious it should be that HDFS will at some point to collect this data too for its usage.
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          Allen Wittenauer Allen- Could you expand a bit? Specifically, where in common would you like us to incorporate this? This is a pretty small and somewhat straightforward change. We are "plugging within" what is already there in terms of the resource monitoring harness in the NM and want to hear what may be an equivalent place in common.

          Show
          srikanthkandula Srikanth Kandula added a comment - Allen Wittenauer Allen- Could you expand a bit? Specifically, where in common would you like us to incorporate this? This is a pretty small and somewhat straightforward change. We are "plugging within" what is already there in terms of the resource monitoring harness in the NM and want to hear what may be an equivalent place in common.
          Hide
          aw Allen Wittenauer added a comment - - edited

          Yes, I recognize that you are building on an already established framework that, prior, only collected metrics that were specific to YARN. But now with network and disk, the collection details are such that all of the sub-projects could benefit. It's shortsighted to build something that could not very easily be used by all.

          That said, the data collection code should be done in a generic way such that, in the future, HDFS could plug into the same collection classes so that it too may make block scheduling decisions. (This has been a discussion point around the HDFS community for a while). YARN could then call those methods that gather the data into its own framework to do whatever it needs to do.

          So while the framework is obviously different the actual work, of e.g. "how do I know the IO stats on file system X", should be in common.

          It could be argued that the previous bits that are also being collected should be in common, but that's already shipped. Let's not repeat past mistakes though.

          Show
          aw Allen Wittenauer added a comment - - edited Yes, I recognize that you are building on an already established framework that, prior, only collected metrics that were specific to YARN. But now with network and disk, the collection details are such that all of the sub-projects could benefit. It's shortsighted to build something that could not very easily be used by all. That said, the data collection code should be done in a generic way such that, in the future, HDFS could plug into the same collection classes so that it too may make block scheduling decisions. (This has been a discussion point around the HDFS community for a while). YARN could then call those methods that gather the data into its own framework to do whatever it needs to do. So while the framework is obviously different the actual work, of e.g. "how do I know the IO stats on file system X", should be in common. It could be argued that the previous bits that are also being collected should be in common, but that's already shipped. Let's not repeat past mistakes though.
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          From Chris Douglas
          "@Allen Wittenauer Is there a corresponding part of the datanode already monitoring these resources? I looked, but found only the metrics. This JIRA and YARN-3819 only extend the monitoring. As Karthik pointed out in YARN-2745, refactoring for more unified resource monitoring is in YARN-3332."

          Show
          srikanthkandula Srikanth Kandula added a comment - From Chris Douglas "@Allen Wittenauer Is there a corresponding part of the datanode already monitoring these resources? I looked, but found only the metrics. This JIRA and YARN-3819 only extend the monitoring. As Karthik pointed out in YARN-2745 , refactoring for more unified resource monitoring is in YARN-3332 ."
          Hide
          elgoiri Íñigo Goiri added a comment -

          Allen Wittenauer, at some point, I talked to Jakob Homan about the possibility of moving the whole ResourceCalculator structure to Common and it seemed like a good idea. Given that and taking advantage of the momentum of this JIRA, I would push for that solution instead of a patch just for this solution.

          Another thing is the resource monitoring part of the ProcessTree and friends; I would leave that alone for now but ultimately, I think the natural place would be Common too.

          Summarizing, I think that if we decide to move this to Common, we should move the whole ResourceCalculator; otherwise, just finish this one here. I'm willing to start the JIRA in Common (or reuse if anybody knows about a JIRA already pushing for that) to have the whole ResourceCalculator there.

          Show
          elgoiri Íñigo Goiri added a comment - Allen Wittenauer , at some point, I talked to Jakob Homan about the possibility of moving the whole ResourceCalculator structure to Common and it seemed like a good idea. Given that and taking advantage of the momentum of this JIRA, I would push for that solution instead of a patch just for this solution. Another thing is the resource monitoring part of the ProcessTree and friends; I would leave that alone for now but ultimately, I think the natural place would be Common too. Summarizing, I think that if we decide to move this to Common, we should move the whole ResourceCalculator; otherwise, just finish this one here. I'm willing to start the JIRA in Common (or reuse if anybody knows about a JIRA already pushing for that) to have the whole ResourceCalculator there.
          Hide
          grey Lei Guo added a comment -

          Moving the implementation into common, it may help to reduce the development effort and maintenance of code, but still with extra overhead in a production environment because different component need collect similar information. And as the polling could occur at different time for different component, they may behave differently,
          Ideally, there should be one centrally place/component to collect node metrics and provide related information to different services, something like the master LIM in Platform LSF. Maybe the timeline service could take this role in the future.

          Show
          grey Lei Guo added a comment - Moving the implementation into common, it may help to reduce the development effort and maintenance of code, but still with extra overhead in a production environment because different component need collect similar information. And as the polling could occur at different time for different component, they may behave differently, Ideally, there should be one centrally place/component to collect node metrics and provide related information to different services, something like the master LIM in Platform LSF. Maybe the timeline service could take this role in the future.
          Hide
          chris.douglas Chris Douglas added a comment -

          I think that if we decide to move this to Common, we should move the whole ResourceCalculator; otherwise, just finish this one here. I'm willing to start the JIRA in Common (or reuse if anybody knows about a JIRA already pushing for that) to have the whole ResourceCalculator there.

          +1 Let's just do this and move on.

          Show
          chris.douglas Chris Douglas added a comment - I think that if we decide to move this to Common, we should move the whole ResourceCalculator; otherwise, just finish this one here. I'm willing to start the JIRA in Common (or reuse if anybody knows about a JIRA already pushing for that) to have the whole ResourceCalculator there. +1 Let's just do this and move on.
          Hide
          chris.douglas Chris Douglas added a comment -

          Rebased patch

          Show
          chris.douglas Chris Douglas added a comment - Rebased patch
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 18m 6s Findbugs (version ) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 57s There were no new javac warning messages.
          +1 javadoc 11m 34s There were no new javadoc warning messages.
          +1 release audit 0m 36s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 2m 15s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 50s mvn install still works.
          +1 eclipse:eclipse 0m 45s The patch built with eclipse:eclipse.
          +1 findbugs 5m 10s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 common tests 25m 40s Tests failed in hadoop-common.
          +1 tools/hadoop tests 16m 11s Tests passed in hadoop-gridmix.
          -1 yarn tests 2m 18s Tests failed in hadoop-yarn-common.
              92m 25s  



          Reason Tests
          Failed unit tests hadoop.ha.TestZKFailoverController
            hadoop.yarn.logaggregation.TestAggregatedLogDeletionService



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12744567/HADOOP-12210.000.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f4ca530
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/testReport/
          Java 1.7.0_55
          uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 18m 6s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 57s There were no new javac warning messages. +1 javadoc 11m 34s There were no new javadoc warning messages. +1 release audit 0m 36s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 15s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 50s mvn install still works. +1 eclipse:eclipse 0m 45s The patch built with eclipse:eclipse. +1 findbugs 5m 10s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 common tests 25m 40s Tests failed in hadoop-common. +1 tools/hadoop tests 16m 11s Tests passed in hadoop-gridmix. -1 yarn tests 2m 18s Tests failed in hadoop-yarn-common.     92m 25s   Reason Tests Failed unit tests hadoop.ha.TestZKFailoverController   hadoop.yarn.logaggregation.TestAggregatedLogDeletionService Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12744567/HADOOP-12210.000.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f4ca530 hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/artifact/patchprocess/testrun_hadoop-yarn-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/testReport/ Java 1.7.0_55 uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7215/console This message was automatically generated.
          Hide
          chris.douglas Chris Douglas added a comment -

          +1

          I committed this. Thanks, Robert

          Show
          chris.douglas Chris Douglas added a comment - +1 I committed this. Thanks, Robert
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8144 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8144/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8144 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8144/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #252 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/252/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #252 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/252/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #982 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/982/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #982 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/982/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2179/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2179/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2198/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2198/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/240/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/240/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/250/)
          HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/250/ ) HADOOP-12210 . Collect network usage on the node. Contributed by Robert Grandl (cdouglas: rev 1a0752d85a15499d120b4a79af9bd740fcd1f8e0) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java

            People

            • Assignee:
              rgrandl Robert Grandl
              Reporter:
              rgrandl Robert Grandl
            • Votes:
              1 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development