Details

    • Hadoop Flags:
      Reviewed
    • Flags:
      Patch

      Description

      In this JIRA we propose to collect disks usages on a node. This JIRA is part of a larger effort of monitoring resource usages on the nodes.

      1. YARN-3820-4.patch
        20 kB
        Robert Grandl
      2. YARN-3820-3.patch
        19 kB
        Robert Grandl
      3. YARN-3820-2.patch
        18 kB
        Robert Grandl
      4. YARN-3820-1.patch
        12 kB
        Robert Grandl
      5. HADOOP-12211-2.patch
        19 kB
        Robert Grandl
      6. HADOOP-12211-1.patch
        18 kB
        Robert Grandl
      7. HADOOP-12211.003.patch
        19 kB
        Chris Douglas

        Issue Links

          Activity

          Hide
          rgrandl Robert Grandl added a comment -

          Srikanth Kandula and I were proposing to collect the disks usages on a node. This is part of a larger effort of multi-resource scheduling. Currently, yarn does not have any mechanism to monitor the amount of bytes read/written from/to disks.

          Show
          rgrandl Robert Grandl added a comment - Srikanth Kandula and I were proposing to collect the disks usages on a node. This is part of a larger effort of multi-resource scheduling. Currently, yarn does not have any mechanism to monitor the amount of bytes read/written from/to disks.
          Hide
          rgrandl Robert Grandl added a comment -

          Added first cut patch

          Show
          rgrandl Robert Grandl added a comment - Added first cut patch
          Hide
          rgrandl Robert Grandl added a comment -

          Short description:
          This JIRA collects bytes read/written from/to disks in Linux.
          Step 1: We exploit the "/proc/diskstats" counters, extract the number of sectors read/written for every disk, and return the aggregation of these counters among all the disks.

          Step 2: To convert sectors into bytes, for every disk, we extract the sector size from "/sys/block/diskName/queue/hw_sector_size".

          Step 3: Finally by multiplying the number of sectors from Step 1 with sector size from Step 2 we compute the number of bytes.

          We tested the existence of these files in the following Linux kernel versions:
          Linux 3.2.0
          Linux 2.6.32
          Linux 3.13.0

          Also, doing further search on the web, it seems people are using/recommending these files for extracting read/written disks counters

          Show
          rgrandl Robert Grandl added a comment - Short description: This JIRA collects bytes read/written from/to disks in Linux. Step 1: We exploit the "/proc/diskstats" counters, extract the number of sectors read/written for every disk, and return the aggregation of these counters among all the disks. Step 2: To convert sectors into bytes, for every disk, we extract the sector size from "/sys/block/diskName/queue/hw_sector_size". Step 3: Finally by multiplying the number of sectors from Step 1 with sector size from Step 2 we compute the number of bytes. We tested the existence of these files in the following Linux kernel versions: Linux 3.2.0 Linux 2.6.32 Linux 3.13.0 Also, doing further search on the web, it seems people are using/recommending these files for extracting read/written disks counters
          Hide
          rgrandl Robert Grandl added a comment -

          Remove whitespaces and same build crash as YARN-3819-3.patch

          Show
          rgrandl Robert Grandl added a comment - Remove whitespaces and same build crash as YARN-3819 -3.patch
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 17m 44s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 34s There were no new javac warning messages.
          -1 javadoc 9m 35s The applied patch generated 3 additional warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 31s The applied patch generated 17 new checkstyle issues (total was 15, now 32).
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 35s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 3m 37s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 tools/hadoop tests 15m 46s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 58s Tests passed in hadoop-yarn-common.
          +1 yarn tests 6m 7s Tests passed in hadoop-yarn-server-nodemanager.
              66m 41s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740300/YARN-3820-3.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 295d678
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/diffJavadocWarnings.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8279/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8279/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 44s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 34s There were no new javac warning messages. -1 javadoc 9m 35s The applied patch generated 3 additional warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 31s The applied patch generated 17 new checkstyle issues (total was 15, now 32). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 35s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 3m 37s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 tools/hadoop tests 15m 46s Tests passed in hadoop-gridmix. +1 yarn tests 1m 58s Tests passed in hadoop-yarn-common. +1 yarn tests 6m 7s Tests passed in hadoop-yarn-server-nodemanager.     66m 41s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740300/YARN-3820-3.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 295d678 javadoc https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/diffJavadocWarnings.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-yarn-common.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8279/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8279/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8279/console This message was automatically generated.
          Hide
          rgrandl Robert Grandl added a comment -

          Fixed checkstyles and javadoc

          Show
          rgrandl Robert Grandl added a comment - Fixed checkstyles and javadoc
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 17m 46s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
          +1 javac 7m 37s There were no new javac warning messages.
          +1 javadoc 9m 37s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 47s The applied patch generated 2 new checkstyle issues (total was 47, now 49).
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 35s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 3m 35s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 tools/hadoop tests 16m 33s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 59s Tests passed in hadoop-yarn-common.
          +1 yarn tests 6m 27s Tests passed in hadoop-yarn-server-nodemanager.
              68m 10s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740455/YARN-3820-4.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / 5b5bb8d
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8288/testReport/
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8288/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 46s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 37s There were no new javac warning messages. +1 javadoc 9m 37s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 47s The applied patch generated 2 new checkstyle issues (total was 47, now 49). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 35s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 3m 35s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 tools/hadoop tests 16m 33s Tests passed in hadoop-gridmix. +1 yarn tests 1m 59s Tests passed in hadoop-yarn-common. +1 yarn tests 6m 27s Tests passed in hadoop-yarn-server-nodemanager.     68m 10s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740455/YARN-3820-4.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / 5b5bb8d checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-yarn-common.txt hadoop-yarn-server-nodemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8288/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8288/console This message was automatically generated.
          Hide
          rgrandl Robert Grandl added a comment -

          Hadoop QA - could you please rerun the checks ? I cannot fix checkstyle as it does not show anything to fix here: https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt.

          Show
          rgrandl Robert Grandl added a comment - Hadoop QA - could you please rerun the checks ? I cannot fix checkstyle as it does not show anything to fix here: https://builds.apache.org/job/PreCommit-YARN-Build/8288/artifact/patchprocess/diffcheckstylehadoop-yarn-common.txt .
          Hide
          elgoiri Íñigo Goiri added a comment -

          You may want to exclude the change in CommonNodeLabelsManager.java as it's not related to this patch.

          Show
          elgoiri Íñigo Goiri added a comment - You may want to exclude the change in CommonNodeLabelsManager.java as it's not related to this patch.
          Hide
          rgrandl Robert Grandl added a comment -

          Íñigo Goiri, I fixed the warning because HadoopQA javadoc was -1. I will revert the change if HadoopQA will return +1.

          Show
          rgrandl Robert Grandl added a comment - Íñigo Goiri , I fixed the warning because HadoopQA javadoc was -1. I will revert the change if HadoopQA will return +1.
          Hide
          aw Allen Wittenauer added a comment -

          -1

          This needs to go into common. I don't know how much more obvious it should be that HDFS will at some point to collect this data too for its usage.

          Show
          aw Allen Wittenauer added a comment - -1 This needs to go into common. I don't know how much more obvious it should be that HDFS will at some point to collect this data too for its usage.
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          Similar discussion ongoing at YARN-3819.

          Show
          srikanthkandula Srikanth Kandula added a comment - Similar discussion ongoing at YARN-3819 .
          Hide
          chris.douglas Chris Douglas added a comment -

          Allen Wittenauer Is there a corresponding part of the datanode already monitoring these resources? I looked, but found only the metrics. This JIRA and YARN-3819 only extend the monitoring. As Karthik pointed out in YARN-2745, refactoring for more unified resource monitoring is in YARN-3332.

          On the patch: looks good, though why does the disk need a forcedRead parameter?

          Show
          chris.douglas Chris Douglas added a comment - Allen Wittenauer Is there a corresponding part of the datanode already monitoring these resources? I looked, but found only the metrics. This JIRA and YARN-3819 only extend the monitoring. As Karthik pointed out in YARN-2745 , refactoring for more unified resource monitoring is in YARN-3332 . On the patch: looks good, though why does the disk need a forcedRead parameter?
          Hide
          chris.douglas Chris Douglas added a comment -

          Oh, didn't see YARN-3819. Will continue there.

          Show
          chris.douglas Chris Douglas added a comment - Oh, didn't see YARN-3819 . Will continue there.
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          Copied Chris Douglas comment to 3820 as well.

          Chris Douglas The intention with forcedRead is to allow the caller to decide whether or not a fresh read of the /proc is needed. If set to false, the code responds with the previously read readings. This is just to amortize cost of polling...

          Show
          srikanthkandula Srikanth Kandula added a comment - Copied Chris Douglas comment to 3820 as well. Chris Douglas The intention with forcedRead is to allow the caller to decide whether or not a fresh read of the /proc is needed. If set to false, the code responds with the previously read readings. This is just to amortize cost of polling...
          Hide
          chris.douglas Chris Douglas added a comment -

          I understand its function, I'm curious why it was added (CPU doesn't include this). Did you notice an overhead?

          Show
          chris.douglas Chris Douglas added a comment - I understand its function, I'm curious why it was added (CPU doesn't include this). Did you notice an overhead?
          Hide
          srikanthkandula Srikanth Kandula added a comment -

          Quick profile: the call to read /proc takes about 1ms per call. So, perhaps not a big deal. We are just trying to facilitate better usage mode for this API method...

          Show
          srikanthkandula Srikanth Kandula added a comment - Quick profile: the call to read /proc takes about 1ms per call. So, perhaps not a big deal. We are just trying to facilitate better usage mode for this API method...
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 patch 0m 0s The patch command could not apply the patch during dryrun.



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12740455/YARN-3820-4.patch
          Optional Tests javac unit findbugs checkstyle javadoc
          git revision trunk / f4ca530
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7216/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12740455/YARN-3820-4.patch Optional Tests javac unit findbugs checkstyle javadoc git revision trunk / f4ca530 Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7216/console This message was automatically generated.
          Hide
          chris.douglas Chris Douglas added a comment -

          Robert Grandl: Please port the patch to fit with HADOOP-12180, as in HADOOP-12210

          Show
          chris.douglas Chris Douglas added a comment - Robert Grandl : Please port the patch to fit with HADOOP-12180 , as in HADOOP-12210
          Hide
          rgrandl Robert Grandl added a comment -

          YARN-3820 rebased for HADOOP-12211

          Show
          rgrandl Robert Grandl added a comment - YARN-3820 rebased for HADOOP-12211
          Hide
          rgrandl Robert Grandl added a comment -

          Chris Douglas: I ported the patch to fit with HADOOP-12180 as in HADOOP-12210. Can you review please ?

          Show
          rgrandl Robert Grandl added a comment - Chris Douglas : I ported the patch to fit with HADOOP-12180 as in HADOOP-12210 . Can you review please ?
          Hide
          chris.douglas Chris Douglas added a comment -

          The patch fails its own unit test.

          • It's missing a call to readProcDiskInfoFile with getStorageBytesRead and getStorageBytesWritten
          • The assertEquals parameters are backwards. They should be assertEquals(expectedValue, actualValue)
          • The perDiskSectorSize member field is never assigned a non-null value

          Please fix (and test) the patch.

          Show
          chris.douglas Chris Douglas added a comment - The patch fails its own unit test. It's missing a call to readProcDiskInfoFile with getStorageBytesRead and getStorageBytesWritten The assertEquals parameters are backwards. They should be assertEquals(expectedValue, actualValue) The perDiskSectorSize member field is never assigned a non-null value Please fix (and test) the patch.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 15m 43s Findbugs (version ) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 34s There were no new javac warning messages.
          +1 javadoc 9m 32s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 18s There were no new checkstyle issues.
          -1 whitespace 0m 2s The patch has 7 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 20s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 4m 15s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 common tests 21m 54s Tests failed in hadoop-common.
          +1 tools/hadoop tests 14m 28s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.
              79m 1s  



          Reason Tests
          Failed unit tests hadoop.util.TestSysInfoLinux



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12744670/HADOOP-12211-1.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 0824426
          whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 15m 43s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 34s There were no new javac warning messages. +1 javadoc 9m 32s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 18s There were no new checkstyle issues. -1 whitespace 0m 2s The patch has 7 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 20s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 4m 15s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 common tests 21m 54s Tests failed in hadoop-common. +1 tools/hadoop tests 14m 28s Tests passed in hadoop-gridmix. +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.     79m 1s   Reason Tests Failed unit tests hadoop.util.TestSysInfoLinux Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12744670/HADOOP-12211-1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 0824426 whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/artifact/patchprocess/testrun_hadoop-yarn-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7233/console This message was automatically generated.
          Hide
          rgrandl Robert Grandl added a comment -

          Updated patch based on Chris Douglas comments. Thanks Chris !

          Show
          rgrandl Robert Grandl added a comment - Updated patch based on Chris Douglas comments. Thanks Chris !
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 20m 12s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 8m 6s There were no new javac warning messages.
          +1 javadoc 10m 21s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 45s The applied patch generated 4 new checkstyle issues (total was 0, now 4).
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 19s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 4m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 23m 0s Tests passed in hadoop-common.
          +1 tools/hadoop tests 14m 54s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.
              87m 23s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12744788/HADOOP-12211-2.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 47f4c54
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/diffcheckstylehadoop-common.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 20m 12s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 8m 6s There were no new javac warning messages. +1 javadoc 10m 21s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 45s The applied patch generated 4 new checkstyle issues (total was 0, now 4). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 19s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 4m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 23m 0s Tests passed in hadoop-common. +1 tools/hadoop tests 14m 54s Tests passed in hadoop-gridmix. +1 yarn tests 1m 57s Tests passed in hadoop-yarn-common.     87m 23s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12744788/HADOOP-12211-2.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 47f4c54 checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/diffcheckstylehadoop-common.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/artifact/patchprocess/testrun_hadoop-yarn-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7237/console This message was automatically generated.
          Hide
          chris.douglas Chris Douglas added a comment -

          Changes in v3:

          • Added synchronized block around updating sector size in the map. While the thread safety for this class needs specific attention, the existing cases will only return stale/inconsistent data. Errors that arise from adding elements to a HashMap without synchronization (as in v2) are not benign (though unlikely in this setting).
          • The unit test assumes that /sys/block/sd{a,c,e,f}/queue/hw_sector_size will either not exist or be 512 on the machine it's running on. That assumption may not always hold. Updated the unit test to return a synthetic value for all disks, though the parsing logic for the sector size could also be tested.
          • The fReader param complicates the catch block unnecessarily. This matches the rest of the class, so v3 keeps the pattern and just eliminates the variable.

          Also cleaned up some checkstyle issues.

          Show
          chris.douglas Chris Douglas added a comment - Changes in v3: Added synchronized block around updating sector size in the map. While the thread safety for this class needs specific attention, the existing cases will only return stale/inconsistent data. Errors that arise from adding elements to a HashMap without synchronization (as in v2) are not benign (though unlikely in this setting). The unit test assumes that /sys/block/sd{a,c,e,f}/queue/hw_sector_size will either not exist or be 512 on the machine it's running on. That assumption may not always hold. Updated the unit test to return a synthetic value for all disks, though the parsing logic for the sector size could also be tested. The fReader param complicates the catch block unnecessarily. This matches the rest of the class, so v3 keeps the pattern and just eliminates the variable. Also cleaned up some checkstyle issues.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 17m 21s Findbugs (version ) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 37s There were no new javac warning messages.
          +1 javadoc 9m 35s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 44s There were no new checkstyle issues.
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 21s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 20s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 22m 20s Tests passed in hadoop-common.
          +1 tools/hadoop tests 14m 36s Tests passed in hadoop-gridmix.
          +1 yarn tests 1m 58s Tests passed in hadoop-yarn-common.
              81m 56s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12744864/HADOOP-12211.003.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 1ea3629
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-gridmix.txt
          hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-yarn-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 17m 21s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 37s There were no new javac warning messages. +1 javadoc 9m 35s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 44s There were no new checkstyle issues. +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 21s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 20s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 20s Tests passed in hadoop-common. +1 tools/hadoop tests 14m 36s Tests passed in hadoop-gridmix. +1 yarn tests 1m 58s Tests passed in hadoop-yarn-common.     81m 56s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12744864/HADOOP-12211.003.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 1ea3629 hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-common.txt hadoop-gridmix test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-gridmix.txt hadoop-yarn-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/artifact/patchprocess/testrun_hadoop-yarn-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7240/console This message was automatically generated.
          Hide
          chris.douglas Chris Douglas added a comment -

          +1 I committed this to trunk and branch-2. Thanks, Robert.

          Show
          chris.douglas Chris Douglas added a comment - +1 I committed this to trunk and branch-2. Thanks, Robert.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #8159 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8159/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #8159 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8159/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/256/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/256/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #986 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/986/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #986 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/986/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2183 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2183/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2183 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2183/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #244 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/244/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #244 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/244/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2202 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2202/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2202 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2202/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #254 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/254/)
          HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java
          • hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #254 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/254/ ) HADOOP-12211 . Collect disk usage on the node. Contributed by Robert Grandl (cdouglas: rev a431ed9075cf6f467be5ff10f4ffb131cb1d3216) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfo.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoLinux.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestSysInfoLinux.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/ResourceCalculatorPlugin.java hadoop-tools/hadoop-gridmix/src/test/java/org/apache/hadoop/mapred/gridmix/DummyResourceCalculatorPlugin.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java

            People

            • Assignee:
              rgrandl Robert Grandl
              Reporter:
              rgrandl Robert Grandl
            • Votes:
              1 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development