Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9139

Enable parallel JUnit tests for HDFS Pre-commit

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Forked from HADOOP-11984,
      With the initial and significant work from Chris Nauroth, this Jira is to track and support parallel tests' run for HDFS Precommit

      1. HDFS-9139.01.patch
        42 kB
        Vinayakumar B
      2. HDFS-9139.02.patch
        24 kB
        Vinayakumar B
      3. HDFS-9139.03.patch
        24 kB
        Vinayakumar B
      4. HDFS-9139.04.patch
        25 kB
        Vinayakumar B

        Issue Links

          Activity

          Hide
          vinayrpet Vinayakumar B added a comment - - edited

          adding first patch.
          Since HADOOP-11984, is not yet in, this includes those changes as well.

          Show
          vinayrpet Vinayakumar B added a comment - - edited adding first patch. Since HADOOP-11984 , is not yet in, this includes those changes as well.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12685/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12685/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 19m 50s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 21 new or modified test files.
          +1 javac 8m 0s There were no new javac warning messages.
          +1 javadoc 10m 1s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 2m 10s There were no new checkstyle issues.
          +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 26s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 6m 47s Tests passed in hadoop-common.
          -1 hdfs tests 42m 25s Tests failed in hadoop-hdfs.
              96m 28s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.datanode.TestBPOfferService
            hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.namenode.TestProtectedDirectories
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
            hadoop.hdfs.server.namenode.TestEditLogFileOutputStream
            hadoop.hdfs.server.namenode.TestFileLimit
            hadoop.hdfs.server.namenode.TestFileContextXAttr
            hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
            hadoop.hdfs.server.namenode.TestNameNodeHttpServer
            hadoop.hdfs.server.namenode.TestSecureNameNode
            hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
          Timed out tests org.apache.hadoop.hdfs.server.mover.TestMover



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 83e99d0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12685/testReport/
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12685/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 19m 50s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 21 new or modified test files. +1 javac 8m 0s There were no new javac warning messages. +1 javadoc 10m 1s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 10s There were no new checkstyle issues. +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 26s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 6m 47s Tests passed in hadoop-common. -1 hdfs tests 42m 25s Tests failed in hadoop-hdfs.     96m 28s   Reason Tests Failed unit tests hadoop.hdfs.server.datanode.TestBPOfferService   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.namenode.TestProtectedDirectories   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.hdfs.server.namenode.TestEditLogFileOutputStream   hadoop.hdfs.server.namenode.TestFileLimit   hadoop.hdfs.server.namenode.TestFileContextXAttr   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.server.namenode.TestNameNodeHttpServer   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Timed out tests org.apache.hadoop.hdfs.server.mover.TestMover Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 83e99d0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12685/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12685/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12685/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12689/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12689/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 20m 19s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 21 new or modified test files.
          +1 javac 8m 8s There were no new javac warning messages.
          +1 javadoc 10m 2s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 2m 16s There were no new checkstyle issues.
          +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 7m 48s Tests passed in hadoop-common.
          -1 hdfs tests 52m 50s Tests failed in hadoop-hdfs.
              108m 34s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 7fe521b
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12689/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12689/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 20m 19s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 21 new or modified test files. +1 javac 8m 8s There were no new javac warning messages. +1 javadoc 10m 2s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 16s There were no new checkstyle issues. +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 7m 48s Tests passed in hadoop-common. -1 hdfs tests 52m 50s Tests failed in hadoop-hdfs.     108m 34s   Reason Tests Failed unit tests hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 7fe521b whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12689/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12689/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12689/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12692/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12692/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 19m 34s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 21 new or modified test files.
          +1 javac 7m 56s There were no new javac warning messages.
          +1 javadoc 10m 13s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 2m 13s There were no new checkstyle issues.
          +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 common tests 6m 29s Tests failed in hadoop-common.
          -1 hdfs tests 42m 46s Tests failed in hadoop-hdfs.
              96m 15s  



          Reason Tests
          Failed unit tests hadoop.fs.shell.TestTextCommand
            hadoop.metrics2.impl.TestGangliaMetrics
            hadoop.net.TestDNS
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 861b52d
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12692/testReport/
          Java 1.7.0_55
          uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12692/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 19m 34s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 21 new or modified test files. +1 javac 7m 56s There were no new javac warning messages. +1 javadoc 10m 13s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 13s There were no new checkstyle issues. +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 common tests 6m 29s Tests failed in hadoop-common. -1 hdfs tests 42m 46s Tests failed in hadoop-hdfs.     96m 15s   Reason Tests Failed unit tests hadoop.fs.shell.TestTextCommand   hadoop.metrics2.impl.TestGangliaMetrics   hadoop.net.TestDNS   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 861b52d Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12692/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12692/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12692/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12694/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12694/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 19m 47s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 21 new or modified test files.
          +1 javac 8m 4s There were no new javac warning messages.
          +1 javadoc 10m 13s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 2m 17s There were no new checkstyle issues.
          +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 37s mvn install still works.
          +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse.
          +1 findbugs 4m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 7m 50s Tests passed in hadoop-common.
          -1 hdfs tests 53m 22s Tests failed in hadoop-hdfs.
              108m 57s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / bf37d3d
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12694/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12694/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 19m 47s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 21 new or modified test files. +1 javac 8m 4s There were no new javac warning messages. +1 javadoc 10m 13s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 17s There were no new checkstyle issues. +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 3s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 37s mvn install still works. +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse. +1 findbugs 4m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 7m 50s Tests passed in hadoop-common. -1 hdfs tests 53m 22s Tests failed in hadoop-hdfs.     108m 57s   Reason Tests Failed unit tests hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762445/HDFS-9139.01.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / bf37d3d Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12694/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12694/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12694/console This message was automatically generated.
          Hide
          vinayrpet Vinayakumar B added a comment -

          After HADOOP-11984 is in, updated the patch.

          Show
          vinayrpet Vinayakumar B added a comment - After HADOOP-11984 is in, updated the patch.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12701/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12701/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 17m 50s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 7m 53s There were no new javac warning messages.
          +1 javadoc 10m 4s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 7s There were no new checkstyle issues.
          -1 shellcheck 0m 8s The applied patch generated 1 new shellcheck (v0.3.3) issues (total was 32, now 33).
          -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 2m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 13s Pre-build of native portion
          +1 hdfs tests 162m 2s Tests passed in hadoop-hdfs.
              207m 18s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762587/HDFS-9139.02.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / f0f984e
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          shellcheck https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/diffpatchshellcheck.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/whitespace.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12701/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12701/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 17m 50s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 7m 53s There were no new javac warning messages. +1 javadoc 10m 4s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 7s There were no new checkstyle issues. -1 shellcheck 0m 8s The applied patch generated 1 new shellcheck (v0.3.3) issues (total was 32, now 33). -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 13s Pre-build of native portion +1 hdfs tests 162m 2s Tests passed in hadoop-hdfs.     207m 18s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762587/HDFS-9139.02.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / f0f984e Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html shellcheck https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/diffpatchshellcheck.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12701/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12701/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12701/console This message was automatically generated.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Corrected the test-patch.sh to enable parallel tests

          Show
          vinayrpet Vinayakumar B added a comment - Corrected the test-patch.sh to enable parallel tests
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12702/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12702/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 15m 42s Findbugs (version ) appears to be broken on trunk.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 7m 50s There were no new javac warning messages.
          +1 javadoc 10m 2s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 32s There were no new checkstyle issues.
          +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 38s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          -1 findbugs 2m 30s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings.
          +1 native 3m 12s Pre-build of native portion
          -1 hdfs tests 51m 39s Tests failed in hadoop-hdfs.
              94m 15s  



          Reason Tests
          FindBugs module:hadoop-hdfs
          Failed unit tests hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.TestRollingUpgrade
            hadoop.hdfs.server.namenode.ha.TestHASafeMode
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.hdfs.TestEncryptionZonesWithKMS



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / f0f984e
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/whitespace.txt
          Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12702/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12702/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 15m 42s Findbugs (version ) appears to be broken on trunk. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 7m 50s There were no new javac warning messages. +1 javadoc 10m 2s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 32s There were no new checkstyle issues. +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 38s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. -1 findbugs 2m 30s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings. +1 native 3m 12s Pre-build of native portion -1 hdfs tests 51m 39s Tests failed in hadoop-hdfs.     94m 15s   Reason Tests FindBugs module:hadoop-hdfs Failed unit tests hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.TestRollingUpgrade   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.TestEncryptionZonesWithKMS Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / f0f984e whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/whitespace.txt Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12702/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12702/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12702/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12703/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12703/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 16m 25s Findbugs (version ) appears to be broken on trunk.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 9m 17s There were no new javac warning messages.
          +1 javadoc 11m 13s There were no new javadoc warning messages.
          +1 release audit 0m 35s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 35s There were no new checkstyle issues.
          +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 2m 4s mvn install still works.
          +1 eclipse:eclipse 0m 37s The patch built with eclipse:eclipse.
          -1 findbugs 2m 49s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings.
          +1 native 3m 44s Pre-build of native portion
          -1 hdfs tests 50m 19s Tests failed in hadoop-hdfs.
              97m 53s  



          Reason Tests
          FindBugs module:hadoop-hdfs
          Failed unit tests hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.TestSafeMode



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 1c030c6
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/whitespace.txt
          Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12703/testReport/
          Java 1.7.0_55
          uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12703/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 16m 25s Findbugs (version ) appears to be broken on trunk. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 9m 17s There were no new javac warning messages. +1 javadoc 11m 13s There were no new javadoc warning messages. +1 release audit 0m 35s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 35s There were no new checkstyle issues. +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 2m 4s mvn install still works. +1 eclipse:eclipse 0m 37s The patch built with eclipse:eclipse. -1 findbugs 2m 49s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings. +1 native 3m 44s Pre-build of native portion -1 hdfs tests 50m 19s Tests failed in hadoop-hdfs.     97m 53s   Reason Tests FindBugs module:hadoop-hdfs Failed unit tests hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.TestSafeMode Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 1c030c6 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/whitespace.txt Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12703/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12703/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12703/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12853/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12853/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 19m 59s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 8m 50s There were no new javac warning messages.
          +1 javadoc 11m 31s There were no new javadoc warning messages.
          -1 release audit 0m 22s The applied patch generated 1 release audit warnings.
          +1 checkstyle 1m 33s There were no new checkstyle issues.
          +1 shellcheck 0m 11s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 44s mvn install still works.
          +1 eclipse:eclipse 0m 38s The patch built with eclipse:eclipse.
          +1 findbugs 2m 45s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 47s Pre-build of native portion
          -1 hdfs tests 66m 41s Tests failed in hadoop-hdfs.
              118m 6s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.balancer.TestBalancer
            hadoop.hdfs.web.TestWebHdfsFileSystemContract
            hadoop.hdfs.server.datanode.TestDeleteBlockPool
            hadoop.hdfs.web.TestWebHDFS
          Timed out tests org.apache.hadoop.hdfs.TestEncryptedTransfer



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 35affec
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/patchReleaseAuditProblems.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/whitespace.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12853/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12853/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 19m 59s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 8m 50s There were no new javac warning messages. +1 javadoc 11m 31s There were no new javadoc warning messages. -1 release audit 0m 22s The applied patch generated 1 release audit warnings. +1 checkstyle 1m 33s There were no new checkstyle issues. +1 shellcheck 0m 11s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 44s mvn install still works. +1 eclipse:eclipse 0m 38s The patch built with eclipse:eclipse. +1 findbugs 2m 45s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 47s Pre-build of native portion -1 hdfs tests 66m 41s Tests failed in hadoop-hdfs.     118m 6s   Reason Tests Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.balancer.TestBalancer   hadoop.hdfs.web.TestWebHdfsFileSystemContract   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.web.TestWebHDFS Timed out tests org.apache.hadoop.hdfs.TestEncryptedTransfer Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 35affec Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/patchReleaseAuditProblems.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12853/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12853/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12853/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12859/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12859/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 18m 8s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 8m 2s There were no new javac warning messages.
          +1 javadoc 10m 25s There were no new javadoc warning messages.
          -1 release audit 0m 20s The applied patch generated 1 release audit warnings.
          +1 checkstyle 1m 25s There were no new checkstyle issues.
          +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues.
          -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 29s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 2m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 15s Pre-build of native portion
          +1 hdfs tests 49m 42s Tests passed in hadoop-hdfs.
              96m 2s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 1107bd3
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/patchReleaseAuditProblems.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/whitespace.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12859/testReport/
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12859/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 18m 8s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 8m 2s There were no new javac warning messages. +1 javadoc 10m 25s There were no new javadoc warning messages. -1 release audit 0m 20s The applied patch generated 1 release audit warnings. +1 checkstyle 1m 25s There were no new checkstyle issues. +1 shellcheck 0m 8s There were no new shellcheck (v0.3.3) issues. -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 29s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 15s Pre-build of native portion +1 hdfs tests 49m 42s Tests passed in hadoop-hdfs.     96m 2s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762600/HDFS-9139.03.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 1107bd3 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/patchReleaseAuditProblems.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12859/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12859/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12859/console This message was automatically generated.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Uploading patch
          Removed unnecessary change in DFSConfigKeys.java

          Show
          vinayrpet Vinayakumar B added a comment - Uploading patch Removed unnecessary change in DFSConfigKeys.java
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12863/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12863/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          -1 pre-patch 16m 25s Findbugs (version ) appears to be broken on trunk.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 8m 19s There were no new javac warning messages.
          +1 javadoc 10m 18s There were no new javadoc warning messages.
          -1 release audit 0m 19s The applied patch generated 1 release audit warnings.
          +1 checkstyle 0m 40s There were no new checkstyle issues.
          +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 38s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
          +1 findbugs 2m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 11s Pre-build of native portion
          -1 hdfs tests 51m 8s Tests failed in hadoop-hdfs.
              95m 15s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.datanode.TestFsDatasetCache



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 1107bd3
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12863/artifact/patchprocess/patchReleaseAuditProblems.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12863/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12863/testReport/
          Java 1.7.0_55
          uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12863/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. -1 pre-patch 16m 25s Findbugs (version ) appears to be broken on trunk. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 8m 19s There were no new javac warning messages. +1 javadoc 10m 18s There were no new javadoc warning messages. -1 release audit 0m 19s The applied patch generated 1 release audit warnings. +1 checkstyle 0m 40s There were no new checkstyle issues. +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 38s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 2m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 11s Pre-build of native portion -1 hdfs tests 51m 8s Tests failed in hadoop-hdfs.     95m 15s   Reason Tests Failed unit tests hadoop.hdfs.server.datanode.TestFsDatasetCache Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 1107bd3 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12863/artifact/patchprocess/patchReleaseAuditProblems.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12863/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12863/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12863/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12890/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12890/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 20m 37s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 9m 11s There were no new javac warning messages.
          +1 javadoc 11m 29s There were no new javadoc warning messages.
          -1 release audit 0m 21s The applied patch generated 1 release audit warnings.
          +1 checkstyle 1m 37s There were no new checkstyle issues.
          +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 42s mvn install still works.
          +1 eclipse:eclipse 0m 38s The patch built with eclipse:eclipse.
          -1 findbugs 2m 22s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs compilation is broken.
          +1 findbugs 2m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 0m 13s Pre-build of native portion
          -1 hdfs tests 64m 43s Tests failed in hadoop-hdfs.
              113m 8s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.TestRecoverStripedFile
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.fs.TestHdfsNativeCodeLoader



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 8f19538
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12890/artifact/patchprocess/patchReleaseAuditProblems.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12890/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12890/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12890/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 20m 37s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 9m 11s There were no new javac warning messages. +1 javadoc 11m 29s There were no new javadoc warning messages. -1 release audit 0m 21s The applied patch generated 1 release audit warnings. +1 checkstyle 1m 37s There were no new checkstyle issues. +1 shellcheck 0m 9s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 42s mvn install still works. +1 eclipse:eclipse 0m 38s The patch built with eclipse:eclipse. -1 findbugs 2m 22s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs compilation is broken. +1 findbugs 2m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 0m 13s Pre-build of native portion -1 hdfs tests 64m 43s Tests failed in hadoop-hdfs.     113m 8s   Reason Tests Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.TestRecoverStripedFile   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.fs.TestHdfsNativeCodeLoader Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 8f19538 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12890/artifact/patchprocess/patchReleaseAuditProblems.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12890/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12890/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12890/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12929/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12929/console in case of problems.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 18m 26s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 8m 8s There were no new javac warning messages.
          +1 javadoc 10m 35s There were no new javadoc warning messages.
          -1 release audit 0m 18s The applied patch generated 1 release audit warnings.
          +1 checkstyle 1m 25s There were no new checkstyle issues.
          +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
          +1 findbugs 2m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 13s Pre-build of native portion
          -1 hdfs tests 49m 9s Tests failed in hadoop-hdfs.
              96m 5s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / 0ff1216
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12929/artifact/patchprocess/patchReleaseAuditProblems.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12929/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12929/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12929/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 18m 26s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 8m 8s There were no new javac warning messages. +1 javadoc 10m 35s There were no new javadoc warning messages. -1 release audit 0m 18s The applied patch generated 1 release audit warnings. +1 checkstyle 1m 25s There were no new checkstyle issues. +1 shellcheck 0m 10s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 2m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 13s Pre-build of native portion -1 hdfs tests 49m 9s Tests failed in hadoop-hdfs.     96m 5s   Reason Tests Failed unit tests hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / 0ff1216 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12929/artifact/patchprocess/patchReleaseAuditProblems.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12929/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12929/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12929/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          A patch to the files used for the QA process has been detected.
          Re-executing against the patched versions to perform further tests.
          The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12932/console in case of problems.

          Show
          hadoopqa Hadoop QA added a comment - A patch to the files used for the QA process has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HDFS-Build/12932/console in case of problems.
          Hide
          vinayrpet Vinayakumar B added a comment -

          I think, from recent runs, parallel-test runs looks to be quite stable.

          Total build time reduces to ~90 mins from ~250 min.

          I think its okay to commit current changes and fix further random issues in follow on jiras.
          Chris Nauroth, Steve Loughran, Haohui Mai Do you agree?

          Show
          vinayrpet Vinayakumar B added a comment - I think, from recent runs, parallel-test runs looks to be quite stable. Total build time reduces to ~90 mins from ~250 min. I think its okay to commit current changes and fix further random issues in follow on jiras. Chris Nauroth , Steve Loughran , Haohui Mai Do you agree?
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s dev-support patch detected.
          0 pre-patch 21m 34s Pre-patch trunk compilation is healthy.
          0 @author 0m 0s Skipping @author checks as test-patch has been patched.
          +1 tests included 0m 0s The patch appears to include 14 new or modified test files.
          +1 javac 8m 38s There were no new javac warning messages.
          +1 javadoc 11m 13s There were no new javadoc warning messages.
          -1 release audit 0m 19s The applied patch generated 1 release audit warnings.
          +1 checkstyle 1m 34s There were no new checkstyle issues.
          +1 shellcheck 0m 11s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 38s mvn install still works.
          +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse.
          +1 findbugs 2m 40s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 24s Pre-build of native portion
          -1 hdfs tests 63m 57s Tests failed in hadoop-hdfs.
              115m 49s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.TestRecoverStripedFile



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch
          Optional Tests shellcheck javadoc javac unit findbugs checkstyle
          git revision trunk / e617cf6
          Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12932/artifact/patchprocess/patchReleaseAuditProblems.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12932/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12932/testReport/
          Java 1.7.0_55
          uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12932/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 21m 34s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 tests included 0m 0s The patch appears to include 14 new or modified test files. +1 javac 8m 38s There were no new javac warning messages. +1 javadoc 11m 13s There were no new javadoc warning messages. -1 release audit 0m 19s The applied patch generated 1 release audit warnings. +1 checkstyle 1m 34s There were no new checkstyle issues. +1 shellcheck 0m 11s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 38s mvn install still works. +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse. +1 findbugs 2m 40s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 24s Pre-build of native portion -1 hdfs tests 63m 57s Tests failed in hadoop-hdfs.     115m 49s   Reason Tests Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.TestRecoverStripedFile Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12765591/HDFS-9139.04.patch Optional Tests shellcheck javadoc javac unit findbugs checkstyle git revision trunk / e617cf6 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12932/artifact/patchprocess/patchReleaseAuditProblems.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12932/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12932/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12932/console This message was automatically generated.
          Hide
          wheat9 Haohui Mai added a comment -

          I think its okay to commit current changes and fix further random issues in follow on jiras.

          Sounds good to me.

          Show
          wheat9 Haohui Mai added a comment - I think its okay to commit current changes and fix further random issues in follow on jiras. Sounds good to me.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Committed to trunk and branch-2.
          Thanks Chris Nauroth for most part of the contribution.
          Thanks All for the support.

          Show
          vinayrpet Vinayakumar B added a comment - Committed to trunk and branch-2. Thanks Chris Nauroth for most part of the contribution. Thanks All for the support.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8618 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8618/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8618 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8618/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #519 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/519/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #519 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/519/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/pom.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1255 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1255/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1255 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1255/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2465 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2465/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • dev-support/test-patch.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2465 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2465/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java dev-support/test-patch.sh
          Hide
          cnauroth Chris Nauroth added a comment -

          Vinayakumar B, thank you for finishing this!

          Show
          cnauroth Chris Nauroth added a comment - Vinayakumar B , thank you for finishing this!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #531 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/531/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #531 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/531/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #490 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/490/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #490 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/490/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2428 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2428/)
          HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • dev-support/test-patch.sh
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2428 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2428/ ) HDFS-9139 . Enable parallel JUnit tests for HDFS Pre-commit (Contributed (vinayakumarb: rev 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt dev-support/test-patch.sh hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/TestSecureNNWithQJM.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRespectsBindHostKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferTestCase.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestHttpsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeHttpServer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/TestSWebHdfsFileContextMainOperations.java
          Hide
          walter.k.su Walter Su added a comment -

          Hi, guys! I have a question: Is it parallel in test suite(class), or parallel in test case?
          It looks like it's parallel in test case.
          https://builds.apache.org/job/PreCommit-HDFS-Build/12871/testReport/org.apache.hadoop.hdfs/TestSafeModeWithStripedFile/
          https://builds.apache.org/job/PreCommit-HDFS-Build/12998/testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestBlockTokenWithDFSStriped/

          These two classes are stable in feature branch. they fail often recently. I found that the running time of two cases in one suite collide.

          Show
          walter.k.su Walter Su added a comment - Hi, guys! I have a question: Is it parallel in test suite(class), or parallel in test case? It looks like it's parallel in test case. https://builds.apache.org/job/PreCommit-HDFS-Build/12871/testReport/org.apache.hadoop.hdfs/TestSafeModeWithStripedFile/ https://builds.apache.org/job/PreCommit-HDFS-Build/12998/testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestBlockTokenWithDFSStriped/ These two classes are stable in feature branch. they fail often recently. I found that the running time of two cases in one suite collide.
          Hide
          vinayrpet Vinayakumar B added a comment -

          AFAIK, Its testsuite in parallel.

          It looks like it's parallel in test case.

          I think, you found this by checking logs for both passed tests and failed test in the same TestSuite right?

          The report shows entire testsuite's logs for passed tests, and only particular testcase's logs for failed tests.
          i.e. Failed Tests' logs also will be included in the passed tests' logs. Thats how you are seeing the collision. and thinking testcases runs in parallel.
          Actually if you directly see the xml reports generated by sure-fire, there will not be any logs test-casewise for passed testcases.

          And For the tests which fails with parallel tests enabled,
          there can be 3 cases,
          1. Port Binding issue, Ideally any port should not be hard coded. But some tests, expect DNs/NNs to restart in same ports, this could be the case.
          2. Files written outside of test.build.data directory.
          3. Waiting time for some events. In parallel tests, it needs to wait little more, since CPUs of build machines will be busy.

          If any of tests fails with some other reasons, then might be some functional issue.

          Show
          vinayrpet Vinayakumar B added a comment - AFAIK, Its testsuite in parallel. It looks like it's parallel in test case. I think, you found this by checking logs for both passed tests and failed test in the same TestSuite right? The report shows entire testsuite's logs for passed tests, and only particular testcase's logs for failed tests. i.e. Failed Tests' logs also will be included in the passed tests' logs. Thats how you are seeing the collision. and thinking testcases runs in parallel. Actually if you directly see the xml reports generated by sure-fire, there will not be any logs test-casewise for passed testcases. And For the tests which fails with parallel tests enabled, there can be 3 cases, 1. Port Binding issue, Ideally any port should not be hard coded. But some tests, expect DNs/NNs to restart in same ports, this could be the case. 2. Files written outside of test.build.data directory. 3. Waiting time for some events. In parallel tests, it needs to wait little more, since CPUs of build machines will be busy. If any of tests fails with some other reasons, then might be some functional issue.
          Hide
          walter.k.su Walter Su added a comment -

          Yes, you're right. Thanks!

          Show
          walter.k.su Walter Su added a comment - Yes, you're right. Thanks!
          Hide
          cnauroth Chris Nauroth added a comment -

          Vinay is correct. I specifically chose parallel-per-suite instead of parallel-per-test. Isolation for our tests is already tricky enough when considered just at the suite class level without trying to run individual tests in parallel.

          It would be great if people with an itch to write some patches could jump on any flaky tests that might have been exposed by running in parallel.

          Show
          cnauroth Chris Nauroth added a comment - Vinay is correct. I specifically chose parallel-per-suite instead of parallel-per-test. Isolation for our tests is already tricky enough when considered just at the suite class level without trying to run individual tests in parallel. It would be great if people with an itch to write some patches could jump on any flaky tests that might have been exposed by running in parallel.
          Hide
          liuml07 Mingliang Liu added a comment -
          org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java
          283	      MetricsRecordBuilder rbNew = getMetrics(datanode.getMetrics().name());
          284	      long endWriteValue = getLongCounter("TotalWriteTime", rbNew);
          285	      long endReadValue = getLongCounter("TotalReadTime", rbNew);
          286	      // Lets Metric system update latest metrics
          287	      Thread.sleep(100);
          288	      assertTrue(endReadValue > startReadValue);
          288	      assertTrue(endWriteValue > startWriteValue);
          

          Should we call the sleep before getting the end counter?

          Hoping to resolve recent build failure reported by HDFS-9766.

          Show
          liuml07 Mingliang Liu added a comment - org/apache/hadoop/hdfs/server/datanode/TestDataNodeMetrics.java 283 MetricsRecordBuilder rbNew = getMetrics(datanode.getMetrics().name()); 284 long endWriteValue = getLongCounter( "TotalWriteTime" , rbNew); 285 long endReadValue = getLongCounter( "TotalReadTime" , rbNew); 286 // Lets Metric system update latest metrics 287 Thread .sleep(100); 288 assertTrue(endReadValue > startReadValue); 288 assertTrue(endWriteValue > startWriteValue); Should we call the sleep before getting the end counter? Hoping to resolve recent build failure reported by HDFS-9766 .
          Hide
          vinayrpet Vinayakumar B added a comment -

          Should we call the sleep before getting the end counter?

          Absolutely. Dont know why I didnt see that ..

          Show
          vinayrpet Vinayakumar B added a comment - Should we call the sleep before getting the end counter? Absolutely. Dont know why I didnt see that ..

            People

            • Assignee:
              vinayrpet Vinayakumar B
              Reporter:
              vinayrpet Vinayakumar B
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development