Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9958

BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In a scenario where the corrupt replica is on a failed storage, before it is taken out of blocksMap, there is a race which causes the creation of LocatedBlock on a machines array element that is not populated.

      Following is the root cause,

      final int numCorruptNodes = countNodes(blk).corruptReplicas();
      

      countNodes only looks at nodes with storage state as NORMAL, which in the case where corrupt replica is on failed storage will amount to numCorruptNodes being zero.

      final int numNodes = blocksMap.numNodes(blk);
      

      However, numNodes will count all nodes/storages irrespective of the state of the storage. Therefore numMachines will include such (failed) nodes. The assert would fail only if the system is enabled to catch Assertion errors, otherwise it goes ahead and tries to create LocatedBlock object for that is not put in the machines array.

      Here is the stack trace:

      java.lang.NullPointerException
      	at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeStorageInfo.toDatanodeInfos(DatanodeStorageInfo.java:45)
      	at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeStorageInfo.toDatanodeInfos(DatanodeStorageInfo.java:40)
      	at org.apache.hadoop.hdfs.protocol.LocatedBlock.<init>(LocatedBlock.java:84)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.createLocatedBlock(BlockManager.java:878)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.createLocatedBlock(BlockManager.java:826)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.createLocatedBlockList(BlockManager.java:799)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.createLocatedBlocks(BlockManager.java:899)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1849)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1799)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1712)
      	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:588)
      	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)
      	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:415)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
      	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
      
      1. HDFS-9958.001.patch
        6 kB
        Kuhu Shukla
      2. HDFS-9958.002.patch
        7 kB
        Kuhu Shukla
      3. HDFS-9958.003.patch
        8 kB
        Kuhu Shukla
      4. HDFS-9958.004.patch
        10 kB
        Kuhu Shukla
      5. HDFS-9958.005.patch
        7 kB
        Kuhu Shukla
      6. HDFS-9958-branch-2.001.patch
        6 kB
        Kuhu Shukla
      7. HDFS-9958-branch-2.7.001.patch
        7 kB
        Kuhu Shukla
      8. HDFS-9958-Test-v1.txt
        4 kB
        Kuhu Shukla

        Issue Links

          Activity

          Hide
          kshukla Kuhu Shukla added a comment -

          Attaching a sample test that recreates the issue. Please note the test is as of now not robust to false positives.

          Show
          kshukla Kuhu Shukla added a comment - Attaching a sample test that recreates the issue. Please note the test is as of now not robust to false positives.
          Hide
          kshukla Kuhu Shukla added a comment -

          The patch applies to branch-2.7 only.

          Show
          kshukla Kuhu Shukla added a comment - The patch applies to branch-2.7 only.
          Hide
          kshukla Kuhu Shukla added a comment -

          Attaching v1 of the patch which as per a simpler approach, truncates the machines array o\if there is a difference in the actual and expected length. The test case is a carry forward from the prototype and still susceptible to false positives(WIP). Requesting Kihwal Lee, Chris Nauroth, Arpit Agarwal for comments, suggestions on this approach.

          Show
          kshukla Kuhu Shukla added a comment - Attaching v1 of the patch which as per a simpler approach, truncates the machines array o\if there is a difference in the actual and expected length. The test case is a carry forward from the prototype and still susceptible to false positives(WIP). Requesting Kihwal Lee , Chris Nauroth , Arpit Agarwal for comments, suggestions on this approach.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 12s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 51s trunk passed
          +1 compile 0m 46s trunk passed with JDK v1.8.0_74
          +1 compile 0m 40s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 20s trunk passed
          +1 mvnsite 0m 50s trunk passed
          +1 mvneclipse 0m 11s trunk passed
          +1 findbugs 1m 54s trunk passed
          +1 javadoc 1m 12s trunk passed with JDK v1.8.0_74
          +1 javadoc 1m 50s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 44s the patch passed
          +1 compile 0m 45s the patch passed with JDK v1.8.0_74
          +1 javac 0m 45s the patch passed
          +1 compile 0m 39s the patch passed with JDK v1.7.0_95
          +1 javac 0m 39s the patch passed
          -1 checkstyle 0m 19s hadoop-hdfs-project/hadoop-hdfs: patch generated 4 new + 139 unchanged - 0 fixed = 143 total (was 139)
          +1 mvnsite 0m 48s the patch passed
          +1 mvneclipse 0m 10s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 9s the patch passed
          +1 javadoc 1m 10s the patch passed with JDK v1.8.0_74
          +1 javadoc 1m 43s the patch passed with JDK v1.7.0_95
          -1 unit 77m 19s hadoop-hdfs in the patch failed with JDK v1.8.0_74.
          -1 unit 73m 45s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          -1 asflicense 0m 44s Patch generated 3 ASF License warnings.
          177m 33s



          Reason Tests
          JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.TestDFSUpgradeFromImage
          JDK v1.8.0_74 Timed out junit tests org.apache.hadoop.hdfs.TestLeaseRecovery2
            org.apache.hadoop.hdfs.TestReplication
            org.apache.hadoop.hdfs.TestDecommission
            org.apache.hadoop.hdfs.TestDFSStripedOutputStream
            org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.hdfs.qjournal.TestSecureNNWithQJM
          JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.hdfs.TestEncryptionZonesWithHA
            org.apache.hadoop.hdfs.TestDFSStorageStateRecovery
            org.apache.hadoop.hdfs.TestRenameWhileOpen
            org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12793766/HDFS-9958.001.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 55569ae07057 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 605fdcb
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14839/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14839/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 51s trunk passed +1 compile 0m 46s trunk passed with JDK v1.8.0_74 +1 compile 0m 40s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 20s trunk passed +1 mvnsite 0m 50s trunk passed +1 mvneclipse 0m 11s trunk passed +1 findbugs 1m 54s trunk passed +1 javadoc 1m 12s trunk passed with JDK v1.8.0_74 +1 javadoc 1m 50s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 44s the patch passed +1 compile 0m 45s the patch passed with JDK v1.8.0_74 +1 javac 0m 45s the patch passed +1 compile 0m 39s the patch passed with JDK v1.7.0_95 +1 javac 0m 39s the patch passed -1 checkstyle 0m 19s hadoop-hdfs-project/hadoop-hdfs: patch generated 4 new + 139 unchanged - 0 fixed = 143 total (was 139) +1 mvnsite 0m 48s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 9s the patch passed +1 javadoc 1m 10s the patch passed with JDK v1.8.0_74 +1 javadoc 1m 43s the patch passed with JDK v1.7.0_95 -1 unit 77m 19s hadoop-hdfs in the patch failed with JDK v1.8.0_74. -1 unit 73m 45s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 asflicense 0m 44s Patch generated 3 ASF License warnings. 177m 33s Reason Tests JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.hdfs.server.namenode.TestEditLog   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.TestFileAppend   hadoop.hdfs.TestDFSUpgradeFromImage JDK v1.8.0_74 Timed out junit tests org.apache.hadoop.hdfs.TestLeaseRecovery2   org.apache.hadoop.hdfs.TestReplication   org.apache.hadoop.hdfs.TestDecommission   org.apache.hadoop.hdfs.TestDFSStripedOutputStream   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.namenode.TestEditLog   hadoop.hdfs.qjournal.TestSecureNNWithQJM JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.hdfs.TestEncryptionZonesWithHA   org.apache.hadoop.hdfs.TestDFSStorageStateRecovery   org.apache.hadoop.hdfs.TestRenameWhileOpen   org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12793766/HDFS-9958.001.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 55569ae07057 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 605fdcb Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14839/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14839/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14839/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          kshukla Kuhu Shukla added a comment -

          Adding Walter Su for comments on the initial proposal patch, along with others.

          Show
          kshukla Kuhu Shukla added a comment - Adding Walter Su for comments on the initial proposal patch, along with others.
          Hide
          walter.k.su Walter Su added a comment -

          The failed storage will be pruned after another HeartbeatManager#heartbeatCheck() and DatanodeDescriptor#updateHeartbeatState(..). Before that, in this case you should also see the warning:

              if (numCorruptNodes != numCorruptReplicas) {
                LOG.warn("Inconsistent number of corrupt replicas for "
                    + blk + " blockMap has " + numCorruptNodes
                    + " but corrupt replicas map has " + numCorruptReplicas);
              }
          

          countNodes(..) uses corruptReplicas for inside calculation. It means countNodes(blk).corruptReplicas() <= corruptReplicas.numCorruptReplicas(blk). There's a simpler fix:

          -    final int numMachines = isCorrupt ? numNodes: numNodes - numCorruptNodes;
          +    final int numMachines = isCorrupt ? numNodes: numNodes - numCorruptReplicas;
          

          And isCorrupt also need a fix.

          Show
          walter.k.su Walter Su added a comment - The failed storage will be pruned after another HeartbeatManager#heartbeatCheck() and DatanodeDescriptor#updateHeartbeatState(..) . Before that, in this case you should also see the warning: if (numCorruptNodes != numCorruptReplicas) { LOG.warn( "Inconsistent number of corrupt replicas for " + blk + " blockMap has " + numCorruptNodes + " but corrupt replicas map has " + numCorruptReplicas); } countNodes(..) uses corruptReplicas for inside calculation. It means countNodes(blk).corruptReplicas() <= corruptReplicas.numCorruptReplicas(blk) . There's a simpler fix: - final int numMachines = isCorrupt ? numNodes: numNodes - numCorruptNodes; + final int numMachines = isCorrupt ? numNodes: numNodes - numCorruptReplicas; And isCorrupt also need a fix.
          Hide
          kshukla Kuhu Shukla added a comment -

          Updating patch per comments. Added test is now reliable.

          Show
          kshukla Kuhu Shukla added a comment - Updating patch per comments. Added test is now reliable.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 38s trunk passed
          +1 compile 0m 37s trunk passed with JDK v1.8.0_77
          +1 compile 0m 41s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 22s trunk passed
          +1 mvnsite 0m 49s trunk passed
          +1 mvneclipse 0m 14s trunk passed
          +1 findbugs 1m 54s trunk passed
          +1 javadoc 1m 3s trunk passed with JDK v1.8.0_77
          +1 javadoc 1m 46s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 45s the patch passed
          +1 compile 0m 35s the patch passed with JDK v1.8.0_77
          +1 javac 0m 35s the patch passed
          +1 compile 0m 38s the patch passed with JDK v1.7.0_95
          +1 javac 0m 38s the patch passed
          +1 checkstyle 0m 20s the patch passed
          +1 mvnsite 0m 48s the patch passed
          +1 mvneclipse 0m 11s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 6s the patch passed
          +1 javadoc 1m 6s the patch passed with JDK v1.8.0_77
          +1 javadoc 1m 45s the patch passed with JDK v1.7.0_95
          -1 unit 59m 0s hadoop-hdfs in the patch failed with JDK v1.8.0_77.
          -1 unit 53m 20s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          137m 12s



          Reason Tests
          JDK v1.8.0_77 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            hadoop.hdfs.TestFileCorruption



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799304/HDFS-9958.002.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 6e7a2dcae2f5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / d8b729e
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15185/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15185/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 38s trunk passed +1 compile 0m 37s trunk passed with JDK v1.8.0_77 +1 compile 0m 41s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 22s trunk passed +1 mvnsite 0m 49s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 54s trunk passed +1 javadoc 1m 3s trunk passed with JDK v1.8.0_77 +1 javadoc 1m 46s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 45s the patch passed +1 compile 0m 35s the patch passed with JDK v1.8.0_77 +1 javac 0m 35s the patch passed +1 compile 0m 38s the patch passed with JDK v1.7.0_95 +1 javac 0m 38s the patch passed +1 checkstyle 0m 20s the patch passed +1 mvnsite 0m 48s the patch passed +1 mvneclipse 0m 11s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 6s the patch passed +1 javadoc 1m 6s the patch passed with JDK v1.8.0_77 +1 javadoc 1m 45s the patch passed with JDK v1.7.0_95 -1 unit 59m 0s hadoop-hdfs in the patch failed with JDK v1.8.0_77. -1 unit 53m 20s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 137m 12s Reason Tests JDK v1.8.0_77 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl JDK v1.7.0_95 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   hadoop.hdfs.TestFileCorruption Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799304/HDFS-9958.002.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 6e7a2dcae2f5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d8b729e Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15185/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15185/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15185/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          walter.k.su Walter Su added a comment -

          Thanks Kuhu Shukla for the update. I've noticed testArrayOutOfBoundsException() failed. It tries to simulate DatanodeProtocol#reportBadBlocks(..) from 3rd DN. But "TEST" is not a real storageID, so the block isn't added to blocksMap. A fix is to get the real storageID from 3rd DN. Could you re-post a patch to fix this?

          Show
          walter.k.su Walter Su added a comment - Thanks Kuhu Shukla for the update. I've noticed testArrayOutOfBoundsException() failed. It tries to simulate DatanodeProtocol#reportBadBlocks(..) from 3rd DN. But "TEST" is not a real storageID, so the block isn't added to blocksMap. A fix is to get the real storageID from 3rd DN. Could you re-post a patch to fix this?
          Hide
          kshukla Kuhu Shukla added a comment -

          Thanks Walter Su. I looked at the test failure. I think the use of 'corruptReplicas' for numMachines may have been a wrong choice. In a case where something leads to the inconsistent state , for eg. findAndMarkBlockAsCorrupt adds the replica to the corruptsReplica Map whether or not it is present in the blocksMap, the WARN log shows up but should not cause the out of bounds exception. IMHO , we should use only blocksMap as much as possible to decide the size of the array, which would mean that we fix countNodes().corruptReplicas() to return the number after going thru all storages( irrespective of their state) that have the corruptNodes (in this case), since numNodes() is storage state agnostic.

          Would appreciate your comments on this and please correct me if I am missing something here. Thanks a lot!

          Show
          kshukla Kuhu Shukla added a comment - Thanks Walter Su . I looked at the test failure. I think the use of 'corruptReplicas' for numMachines may have been a wrong choice. In a case where something leads to the inconsistent state , for eg. findAndMarkBlockAsCorrupt adds the replica to the corruptsReplica Map whether or not it is present in the blocksMap, the WARN log shows up but should not cause the out of bounds exception. IMHO , we should use only blocksMap as much as possible to decide the size of the array, which would mean that we fix countNodes().corruptReplicas() to return the number after going thru all storages( irrespective of their state) that have the corruptNodes (in this case), since numNodes() is storage state agnostic. Would appreciate your comments on this and please correct me if I am missing something here. Thanks a lot!
          Hide
          walter.k.su Walter Su added a comment -

          we fix countNodes().corruptReplicas() to return the number after going thru all storages( irrespective of their state) that have the corruptNodes (in this case), since numNodes() is storage state agnostic.

          I think countNodes(blk) going thru all storages is unnecessary. Also I think numMachines should only include NORMAL and READ_ONLY. So createLocatedBlock(..) going thru all storages is unnecessary.

              if (numMachines > 0) {
                for(DatanodeStorageInfo storage : blocksMap.getStorages(blk)) {
          

          btw, which is not related to this topic, I think findAndMarkBlockAsCorrupt(..) shouldn't support adding blk to the map if the storage is not found.

          ping Jing Zhao to check if he has any comment.

          Show
          walter.k.su Walter Su added a comment - we fix countNodes().corruptReplicas() to return the number after going thru all storages( irrespective of their state) that have the corruptNodes (in this case), since numNodes() is storage state agnostic. I think countNodes(blk) going thru all storages is unnecessary. Also I think numMachines should only include NORMAL and READ_ONLY. So createLocatedBlock(..) going thru all storages is unnecessary. if (numMachines > 0) { for (DatanodeStorageInfo storage : blocksMap.getStorages(blk)) { btw, which is not related to this topic, I think findAndMarkBlockAsCorrupt(..) shouldn't support adding blk to the map if the storage is not found. ping Jing Zhao to check if he has any comment.
          Hide
          kshukla Kuhu Shukla added a comment -

          Thanks a lot for the helpful comments Walter Su.

          btw, which is not related to this topic, I think findAndMarkBlockAsCorrupt(..) shouldn't support adding blk to the map if the storage is not found.

          I agree, fixing that in v3 of the patch fixes the test in a way and is coherent with the blocksMap and corruptReplicaMap being in sync. It now throws an IOException if such a case is encountered.

          I think countNodes(blk) going thru all storages is unnecessary. Also I think numMachines should only include NORMAL and READ_ONLY. So createLocatedBlock(..) going thru all storages is unnecessary.

          After thinking on this, I agree that failed storages should not count towards any decision that countNodes() is responsible for (which are quite a few), hence no change there.

          Additionally, if the latest change makes sense then having numCorruptNodes seems futile to me. This patch doesn't remove it just yet.

          Show
          kshukla Kuhu Shukla added a comment - Thanks a lot for the helpful comments Walter Su . btw, which is not related to this topic, I think findAndMarkBlockAsCorrupt(..) shouldn't support adding blk to the map if the storage is not found. I agree, fixing that in v3 of the patch fixes the test in a way and is coherent with the blocksMap and corruptReplicaMap being in sync. It now throws an IOException if such a case is encountered. I think countNodes(blk) going thru all storages is unnecessary. Also I think numMachines should only include NORMAL and READ_ONLY. So createLocatedBlock(..) going thru all storages is unnecessary. After thinking on this, I agree that failed storages should not count towards any decision that countNodes() is responsible for (which are quite a few), hence no change there. Additionally, if the latest change makes sense then having numCorruptNodes seems futile to me. This patch doesn't remove it just yet.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 54s trunk passed
          +1 compile 0m 42s trunk passed with JDK v1.8.0_77
          +1 compile 0m 42s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 0m 51s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 59s trunk passed
          +1 javadoc 1m 6s trunk passed with JDK v1.8.0_77
          +1 javadoc 1m 46s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 46s the patch passed
          +1 compile 0m 37s the patch passed with JDK v1.8.0_77
          +1 javac 0m 37s the patch passed
          +1 compile 0m 39s the patch passed with JDK v1.7.0_95
          +1 javac 0m 39s the patch passed
          -1 checkstyle 0m 20s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130)
          +1 mvnsite 0m 48s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 8s the patch passed
          +1 javadoc 1m 3s the patch passed with JDK v1.8.0_77
          +1 javadoc 1m 45s the patch passed with JDK v1.7.0_95
          -1 unit 50m 50s hadoop-hdfs in the patch failed with JDK v1.8.0_77.
          -1 unit 0m 11s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          -1 asflicense 0m 27s Patch generated 1 ASF License warnings.
          76m 54s



          Reason Tests
          JDK v1.8.0_77 Failed junit tests hadoop.hdfs.TestReservedRawPaths
            hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
            hadoop.hdfs.TestModTime
            hadoop.fs.TestUrlStreamHandler
            hadoop.hdfs.security.TestDelegationToken
            hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            hadoop.hdfs.server.namenode.TestFileLimit
            hadoop.hdfs.TestParallelShortCircuitRead
            hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
            hadoop.TestRefreshCallQueue
            hadoop.cli.TestCryptoAdminCLI
            hadoop.hdfs.TestDFSClientRetries
            hadoop.hdfs.TestSetrepDecreasing
            hadoop.hdfs.server.datanode.TestDiskError
            hadoop.fs.viewfs.TestViewFsWithAcls
            hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            hadoop.hdfs.server.namenode.TestAddStripedBlocks
            hadoop.hdfs.server.namenode.TestFSEditLogLoader
            hadoop.hdfs.server.namenode.TestHostsFiles
            hadoop.hdfs.server.datanode.TestTransferRbw
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
            hadoop.fs.contract.hdfs.TestHDFSContractDelete
            hadoop.hdfs.server.namenode.TestFileContextAcl
            hadoop.fs.TestFcHdfsSetUMask
            hadoop.fs.TestUnbuffer
            hadoop.hdfs.server.namenode.TestDeleteRace
            hadoop.hdfs.TestPread
            hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
            hadoop.hdfs.server.namenode.TestFSDirectory
            hadoop.fs.contract.hdfs.TestHDFSContractOpen
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
            hadoop.hdfs.server.datanode.TestStorageReport
            hadoop.hdfs.server.datanode.TestBlockRecovery
            hadoop.hdfs.server.namenode.TestFileTruncate
            hadoop.hdfs.TestReadWhileWriting
            hadoop.fs.contract.hdfs.TestHDFSContractMkdir
            hadoop.fs.contract.hdfs.TestHDFSContractAppend
            hadoop.hdfs.server.datanode.TestFsDatasetCache
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
            hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
            hadoop.hdfs.TestReadStripedFileWithMissingBlocks
            hadoop.hdfs.server.namenode.TestSecondaryWebUi
            hadoop.hdfs.server.namenode.TestMalformedURLs
            hadoop.hdfs.server.namenode.TestAuditLogger
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
            hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
            hadoop.hdfs.server.namenode.TestHDFSConcat
            hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
            hadoop.hdfs.server.datanode.TestCachingStrategy
            hadoop.hdfs.server.namenode.TestAddBlockRetry
            hadoop.fs.TestSymlinkHdfsFileSystem
            hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
            hadoop.fs.viewfs.TestViewFsDefaultValue
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
            hadoop.fs.TestSymlinkHdfsFileContext
            hadoop.hdfs.TestClientProtocolForPipelineRecovery
            hadoop.hdfs.TestFSInputChecker
            hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            hadoop.hdfs.server.datanode.TestDataNodeInitStorage
            hadoop.hdfs.server.mover.TestStorageMover
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
            hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
            hadoop.cli.TestAclCLI
            hadoop.hdfs.security.token.block.TestBlockToken
            hadoop.hdfs.server.namenode.ha.TestHAMetrics
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
            hadoop.hdfs.server.blockmanagement.TestNodeCount
            hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp
            hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
            hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            hadoop.hdfs.TestEncryptedTransfer
            hadoop.hdfs.tools.TestStoragePolicyCommands
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
            hadoop.hdfs.server.datanode.TestHSync
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.namenode.TestNameNodeRpcServer
            hadoop.hdfs.server.datanode.TestDataNodeUUID
            hadoop.hdfs.server.datanode.TestBatchIbr
            hadoop.fs.contract.hdfs.TestHDFSContractSeek
            hadoop.hdfs.server.namenode.TestFileContextXAttr
            hadoop.hdfs.TestAbandonBlock
            hadoop.hdfs.server.namenode.TestAclConfigFlag
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
            hadoop.hdfs.TestAclsEndToEnd
            hadoop.hdfs.TestFileCreationClient
            hadoop.hdfs.qjournal.server.TestJournalNode
            hadoop.hdfs.TestRemoteBlockReader2
            hadoop.hdfs.server.namenode.TestFSImageWithXAttr
            hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            hadoop.hdfs.TestFileAppendRestart
            hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
            hadoop.hdfs.server.namenode.TestFSImageWithAcl
            hadoop.hdfs.qjournal.client.TestQJMWithFaults
            hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks
            hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
            hadoop.hdfs.tools.TestDFSAdminWithHA
            hadoop.hdfs.TestDFSShellGenericOptions
            hadoop.tracing.TestTracing
            hadoop.hdfs.tools.TestDFSZKFailoverController
            hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
            hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
            hadoop.hdfs.TestBlockReaderLocalLegacy
            hadoop.hdfs.TestExternalBlockReader
            hadoop.hdfs.qjournal.TestSecureNNWithQJM
            hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
            hadoop.hdfs.server.namenode.TestParallelImageWrite
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
            hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
            hadoop.hdfs.TestFileConcurrentReader
            hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
            hadoop.hdfs.server.namenode.TestGenericJournalConf
            hadoop.fs.viewfs.TestViewFsWithXAttrs
            hadoop.cli.TestErasureCodingCLI
            hadoop.hdfs.qjournal.TestNNWithQJM
            hadoop.hdfs.TestClose
            hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
            hadoop.hdfs.server.datanode.TestDataNodeExit
            hadoop.hdfs.TestDFSUpgradeFromImage
            hadoop.hdfs.server.namenode.TestEditLogJournalFailures
            hadoop.hdfs.TestPersistBlocks
            hadoop.hdfs.TestDFSRollback
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
            hadoop.hdfs.TestDatanodeReport
            hadoop.tools.TestJMXGet
            hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger
            hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
            hadoop.hdfs.server.namenode.TestNameNodeMXBean
            hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
            hadoop.hdfs.TestFileAppend4
            hadoop.hdfs.tools.TestDebugAdmin
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
            hadoop.fs.contract.hdfs.TestHDFSContractCreate
            hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
            hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
            hadoop.hdfs.server.namenode.TestNameNodeHttpServer
            hadoop.hdfs.server.namenode.TestCreateEditsLog
            hadoop.hdfs.server.namenode.TestFSNamesystemMBean
            hadoop.hdfs.TestWriteRead
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.TestBalancerBandwidth
            hadoop.hdfs.security.TestClientProtocolWithDelegationToken
            hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
            hadoop.hdfs.TestDFSPermission
            hadoop.fs.TestEnhancedByteBufferAccess
            hadoop.fs.TestFcHdfsPermission
            hadoop.hdfs.server.namenode.TestEditLogRace
            hadoop.security.TestRefreshUserMappings
            hadoop.hdfs.TestSafeMode
            hadoop.hdfs.server.namenode.TestAllowFormat
            hadoop.fs.viewfs.TestViewFsHdfs
            hadoop.hdfs.qjournal.client.TestQuorumJournalManager
            hadoop.hdfs.TestDFSRename
            hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
            hadoop.hdfs.TestIsMethodSupported
            hadoop.fs.TestResolveHdfsSymlink
            hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
            hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
            hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
            hadoop.tracing.TestTracingShortCircuitLocalRead
            hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
            hadoop.hdfs.server.namenode.TestDecommissioningStatus
            hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
            hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
            hadoop.hdfs.server.namenode.TestProtectedDirectories
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
            hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
            hadoop.hdfs.qjournal.TestMiniJournalCluster
            hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.tools.TestDelegationTokenFetcher
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
            hadoop.tracing.TestTraceAdmin
            hadoop.hdfs.TestDFSStorageStateRecovery
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
            hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
            hadoop.hdfs.server.namenode.TestNameNodeReconfigure
            hadoop.hdfs.TestDecommission
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.hdfs.server.datanode.TestTriggerBlockReport
            hadoop.hdfs.server.namenode.TestINodeFile
            hadoop.hdfs.TestFSOutputSummer
            hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
            hadoop.hdfs.TestFileLengthOnClusterRestart
            hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
            hadoop.hdfs.TestSetTimes
            hadoop.hdfs.server.namenode.TestQuotaByStorageType
            hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
            hadoop.hdfs.server.namenode.TestNamenodeRetryCache
            hadoop.fs.TestWebHdfsFileContextMainOperations
            hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
            hadoop.hdfs.server.balancer.TestBalancer
            hadoop.fs.TestFcHdfsCreateMkdir
            hadoop.hdfs.TestAppendDifferentChecksum
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
            hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
            hadoop.hdfs.server.namenode.TestBlockUnderConstruction
            hadoop.hdfs.server.mover.TestMover
            hadoop.hdfs.server.namenode.TestDeadDatanode
            hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
            hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
            hadoop.hdfs.TestDFSFinalize
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
            hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
            hadoop.hdfs.TestFileAppend2
            hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
            hadoop.hdfs.server.datanode.TestIncrementalBlockReports
            hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
            hadoop.hdfs.server.datanode.TestBlockScanner
            hadoop.hdfs.server.namenode.TestStorageRestore
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
            hadoop.hdfs.server.namenode.ha.TestHAFsck
            hadoop.fs.viewfs.TestViewFileSystemWithAcls
            hadoop.hdfs.server.namenode.TestXAttrConfigFlag
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
            hadoop.hdfs.TestFsShellPermission
            hadoop.hdfs.TestFileStatusWithECPolicy
            hadoop.hdfs.TestFileAppend3
            hadoop.hdfs.TestDFSInputStream
            hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170
            hadoop.hdfs.TestWriteReadStripedFile
            hadoop.hdfs.TestApplyingStoragePolicy
            hadoop.hdfs.TestQuota
            hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
            hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
            hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
            hadoop.hdfs.server.datanode.TestDataNodeMXBean
            hadoop.hdfs.tools.TestDFSAdmin
            hadoop.hdfs.TestClientBlockVerification
            hadoop.hdfs.TestDFSClientSocketSize
            hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
            hadoop.hdfs.TestDFSClientFailover
            hadoop.hdfs.TestDFSStripedOutputStream
            hadoop.hdfs.server.namenode.TestSnapshotPathINodes
            hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
            hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.security.TestPermission
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.fs.contract.hdfs.TestHDFSContractConcat
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
            hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy
            hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
            hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.server.namenode.TestNestedEncryptionZones
            hadoop.hdfs.server.namenode.TestAuditLogs
            hadoop.hdfs.TestLeaseRecoveryStriped
            hadoop.hdfs.TestListFilesInFileContext
            hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
            hadoop.hdfs.TestMultiThreadedHflush
            hadoop.hdfs.server.datanode.TestDataNodeECN
            hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.security.TestPermissionSymlinks
            hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2
            hadoop.hdfs.server.namenode.TestValidateConfigurationSettings
            hadoop.hdfs.TestDatanodeConfig
            hadoop.hdfs.TestRenameWhileOpen
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
            hadoop.net.TestNetworkTopology
            hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
            hadoop.hdfs.TestHFlush
            hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks
            hadoop.hdfs.TestParallelUnixDomainRead
            hadoop.cli.TestXAttrCLI
            hadoop.hdfs.server.namenode.TestNameEditsConfigs
            hadoop.hdfs.TestEncryptionZonesWithHA
            hadoop.hdfs.server.datanode.TestRefreshNamenodes
            hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
            hadoop.hdfs.TestFileCreationEmpty
            hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.qjournal.server.TestJournalNodeMXBean
            hadoop.fs.contract.hdfs.TestHDFSContractRename
            hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
            hadoop.fs.permission.TestStickyBit
            hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
            hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
            hadoop.hdfs.TestDFSStartupVersions
            hadoop.hdfs.TestFileCreation
            hadoop.hdfs.server.namenode.ha.TestHASafeMode
            hadoop.hdfs.TestMissingBlocksAlert
            hadoop.hdfs.server.namenode.TestSecureNameNode
            hadoop.hdfs.server.namenode.snapshot.TestSnapshot
            hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
            hadoop.hdfs.TestHDFSServerPorts
            hadoop.hdfs.server.namenode.TestTransferFsImage
            hadoop.hdfs.server.namenode.TestStartup
            hadoop.hdfs.server.namenode.TestNameNodeRecovery
            hadoop.hdfs.TestRead
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain
            hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
            hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
            hadoop.hdfs.TestLocalDFS
            hadoop.hdfs.qjournal.client.TestEpochsAreUnique
            hadoop.hdfs.server.datanode.TestDeleteBlockPool
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            hadoop.hdfs.server.datanode.TestLargeBlockReport
            hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
            hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
            hadoop.hdfs.TestBlockReaderFactory
            hadoop.hdfs.server.namenode.TestINodeAttributeProvider
            hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
            hadoop.hdfs.TestPipelines
            hadoop.hdfs.TestReadStripedFileWithDecoding
            hadoop.fs.loadGenerator.TestLoadGenerator
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
            hadoop.hdfs.server.namenode.TestStripedINodeFile
            hadoop.hdfs.TestListFilesInDFS
            hadoop.cli.TestCacheAdminCLI
            hadoop.fs.TestSWebHdfsFileContextMainOperations
            hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
            hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.server.namenode.TestMetadataVersionOutput
            hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
            hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
            hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
            hadoop.fs.TestHDFSFileContextMainOperations
            hadoop.hdfs.server.namenode.TestSaveNamespace
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
            hadoop.hdfs.server.datanode.TestDataNodeLifeline
            hadoop.fs.TestGlobPaths
            hadoop.fs.viewfs.TestViewFsFileStatusHdfs
            hadoop.hdfs.server.namenode.TestMetaSave
            hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
            hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
            hadoop.fs.viewfs.TestViewFsAtHdfsRoot
            hadoop.TestGenericRefresh
            hadoop.hdfs.server.datanode.TestIncrementalBrVariations
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.namenode.ha.TestHAAppend
            hadoop.hdfs.tools.TestGetGroups
            hadoop.hdfs.server.namenode.TestBackupNode
            hadoop.hdfs.server.namenode.TestNameNodeAcl
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.fs.shell.TestHdfsTextCommand
            hadoop.hdfs.TestLargeBlock
            hadoop.cli.TestDeleteCLI
            hadoop.cli.TestHDFSCLI
            hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
            hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
            hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
            hadoop.fs.TestSymlinkHdfsDisable
            hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
            hadoop.hdfs.server.namenode.TestFSImage
            hadoop.fs.viewfs.TestViewFileSystemHdfs
            hadoop.hdfs.server.namenode.TestAddBlock
            hadoop.hdfs.TestReconstructStripedFile
            hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
            hadoop.hdfs.TestDFSInotifyEventInputStream
            hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
            hadoop.hdfs.TestLease
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
            hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
            hadoop.hdfs.server.namenode.TestNameNodeXAttr
            hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
            hadoop.hdfs.server.namenode.TestCheckpoint
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
            hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
            hadoop.hdfs.TestLeaseRecovery
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
          JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
            org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            org.apache.hadoop.hdfs.TestReplication
            org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            org.apache.hadoop.hdfs.TestRollingUpgrade
            org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
            org.apache.hadoop.hdfs.TestClientReportBadBlock



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799971/HDFS-9958.003.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux d8cc76ce225b 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 7da5847
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15238/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15238/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 54s trunk passed +1 compile 0m 42s trunk passed with JDK v1.8.0_77 +1 compile 0m 42s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 23s trunk passed +1 mvnsite 0m 51s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 59s trunk passed +1 javadoc 1m 6s trunk passed with JDK v1.8.0_77 +1 javadoc 1m 46s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 46s the patch passed +1 compile 0m 37s the patch passed with JDK v1.8.0_77 +1 javac 0m 37s the patch passed +1 compile 0m 39s the patch passed with JDK v1.7.0_95 +1 javac 0m 39s the patch passed -1 checkstyle 0m 20s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130) +1 mvnsite 0m 48s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 8s the patch passed +1 javadoc 1m 3s the patch passed with JDK v1.8.0_77 +1 javadoc 1m 45s the patch passed with JDK v1.7.0_95 -1 unit 50m 50s hadoop-hdfs in the patch failed with JDK v1.8.0_77. -1 unit 0m 11s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 asflicense 0m 27s Patch generated 1 ASF License warnings. 76m 54s Reason Tests JDK v1.8.0_77 Failed junit tests hadoop.hdfs.TestReservedRawPaths   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.TestModTime   hadoop.fs.TestUrlStreamHandler   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   hadoop.hdfs.server.namenode.TestFileLimit   hadoop.hdfs.TestParallelShortCircuitRead   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.TestRefreshCallQueue   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.TestDFSClientRetries   hadoop.hdfs.TestSetrepDecreasing   hadoop.hdfs.server.datanode.TestDiskError   hadoop.fs.viewfs.TestViewFsWithAcls   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.namenode.TestAddStripedBlocks   hadoop.hdfs.server.namenode.TestFSEditLogLoader   hadoop.hdfs.server.namenode.TestHostsFiles   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   hadoop.fs.contract.hdfs.TestHDFSContractDelete   hadoop.hdfs.server.namenode.TestFileContextAcl   hadoop.fs.TestFcHdfsSetUMask   hadoop.fs.TestUnbuffer   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.TestPread   hadoop.hdfs.server.namenode.TestReconstructStripedBlocks   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.fs.contract.hdfs.TestHDFSContractOpen   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.hdfs.server.datanode.TestStorageReport   hadoop.hdfs.server.datanode.TestBlockRecovery   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.hdfs.TestReadWhileWriting   hadoop.fs.contract.hdfs.TestHDFSContractMkdir   hadoop.fs.contract.hdfs.TestHDFSContractAppend   hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.namenode.TestSecondaryWebUi   hadoop.hdfs.server.namenode.TestMalformedURLs   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.hdfs.server.namenode.TestHDFSConcat   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   hadoop.hdfs.server.datanode.TestCachingStrategy   hadoop.hdfs.server.namenode.TestAddBlockRetry   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.fs.viewfs.TestViewFsDefaultValue   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.TestClientProtocolForPipelineRecovery   hadoop.hdfs.TestFSInputChecker   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.server.datanode.TestDataNodeInitStorage   hadoop.hdfs.server.mover.TestStorageMover   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling   hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   hadoop.cli.TestAclCLI   hadoop.hdfs.security.token.block.TestBlockToken   hadoop.hdfs.server.namenode.ha.TestHAMetrics   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp   hadoop.hdfs.tools.TestDFSHAAdminMiniCluster   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.hdfs.TestEncryptedTransfer   hadoop.hdfs.tools.TestStoragePolicyCommands   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional   hadoop.hdfs.server.datanode.TestHSync   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.namenode.TestNameNodeRpcServer   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.datanode.TestBatchIbr   hadoop.fs.contract.hdfs.TestHDFSContractSeek   hadoop.hdfs.server.namenode.TestFileContextXAttr   hadoop.hdfs.TestAbandonBlock   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs   hadoop.hdfs.TestAclsEndToEnd   hadoop.hdfs.TestFileCreationClient   hadoop.hdfs.qjournal.server.TestJournalNode   hadoop.hdfs.TestRemoteBlockReader2   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.TestFileAppendRestart   hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.hdfs.qjournal.client.TestQJMWithFaults   hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.hdfs.tools.TestDFSAdminWithHA   hadoop.hdfs.TestDFSShellGenericOptions   hadoop.tracing.TestTracing   hadoop.hdfs.tools.TestDFSZKFailoverController   hadoop.hdfs.server.datanode.TestDataNodeReconfiguration   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.TestBlockReaderLocalLegacy   hadoop.hdfs.TestExternalBlockReader   hadoop.hdfs.qjournal.TestSecureNNWithQJM   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   hadoop.hdfs.server.namenode.TestParallelImageWrite   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.server.namenode.TestNameNodeResourceChecker   hadoop.hdfs.server.namenode.TestGenericJournalConf   hadoop.fs.viewfs.TestViewFsWithXAttrs   hadoop.cli.TestErasureCodingCLI   hadoop.hdfs.qjournal.TestNNWithQJM   hadoop.hdfs.TestClose   hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot   hadoop.hdfs.server.datanode.TestDataNodeExit   hadoop.hdfs.TestDFSUpgradeFromImage   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.TestPersistBlocks   hadoop.hdfs.TestDFSRollback   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   hadoop.hdfs.TestDatanodeReport   hadoop.tools.TestJMXGet   hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger   hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN   hadoop.hdfs.TestFileAppend4   hadoop.hdfs.tools.TestDebugAdmin   hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   hadoop.fs.contract.hdfs.TestHDFSContractCreate   hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands   hadoop.hdfs.server.namenode.TestNameNodeHttpServer   hadoop.hdfs.server.namenode.TestCreateEditsLog   hadoop.hdfs.server.namenode.TestFSNamesystemMBean   hadoop.hdfs.TestWriteRead   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.TestBalancerBandwidth   hadoop.hdfs.security.TestClientProtocolWithDelegationToken   hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   hadoop.hdfs.TestDFSPermission   hadoop.fs.TestEnhancedByteBufferAccess   hadoop.fs.TestFcHdfsPermission   hadoop.hdfs.server.namenode.TestEditLogRace   hadoop.security.TestRefreshUserMappings   hadoop.hdfs.TestSafeMode   hadoop.hdfs.server.namenode.TestAllowFormat   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.hdfs.qjournal.client.TestQuorumJournalManager   hadoop.hdfs.TestDFSRename   hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods   hadoop.hdfs.TestIsMethodSupported   hadoop.fs.TestResolveHdfsSymlink   hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   hadoop.tracing.TestTracingShortCircuitLocalRead   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus   hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots   hadoop.hdfs.server.namenode.TestProtectedDirectories   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.qjournal.TestMiniJournalCluster   hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.tools.TestDelegationTokenFetcher   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.tracing.TestTraceAdmin   hadoop.hdfs.TestDFSStorageStateRecovery   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.hdfs.server.namenode.TestNNThroughputBenchmark   hadoop.hdfs.server.namenode.TestNameNodeReconfigure   hadoop.hdfs.TestDecommission   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.server.datanode.TestTriggerBlockReport   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.hdfs.TestFSOutputSummer   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.TestFileLengthOnClusterRestart   hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs   hadoop.hdfs.TestSetTimes   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.fs.TestWebHdfsFileContextMainOperations   hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs   hadoop.hdfs.server.balancer.TestBalancer   hadoop.fs.TestFcHdfsCreateMkdir   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   hadoop.hdfs.server.namenode.ha.TestNNHealthCheck   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.server.namenode.TestBlockUnderConstruction   hadoop.hdfs.server.mover.TestMover   hadoop.hdfs.server.namenode.TestDeadDatanode   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics   hadoop.hdfs.TestDFSFinalize   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   hadoop.hdfs.server.datanode.TestIncrementalBlockReports   hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.server.namenode.TestEditLog   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs   hadoop.hdfs.server.namenode.ha.TestHAFsck   hadoop.fs.viewfs.TestViewFileSystemWithAcls   hadoop.hdfs.server.namenode.TestXAttrConfigFlag   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.TestFsShellPermission   hadoop.hdfs.TestFileStatusWithECPolicy   hadoop.hdfs.TestFileAppend3   hadoop.hdfs.TestDFSInputStream   hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170   hadoop.hdfs.TestWriteReadStripedFile   hadoop.hdfs.TestApplyingStoragePolicy   hadoop.hdfs.TestQuota   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.server.datanode.TestDataNodeMXBean   hadoop.hdfs.tools.TestDFSAdmin   hadoop.hdfs.TestClientBlockVerification   hadoop.hdfs.TestDFSClientSocketSize   hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.hdfs.TestDFSClientFailover   hadoop.hdfs.TestDFSStripedOutputStream   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.security.TestPermission   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.fs.contract.hdfs.TestHDFSContractConcat   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad   hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.server.namenode.TestNestedEncryptionZones   hadoop.hdfs.server.namenode.TestAuditLogs   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.TestListFilesInFileContext   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.TestMultiThreadedHflush   hadoop.hdfs.server.datanode.TestDataNodeECN   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.security.TestPermissionSymlinks   hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2   hadoop.hdfs.server.namenode.TestValidateConfigurationSettings   hadoop.hdfs.TestDatanodeConfig   hadoop.hdfs.TestRenameWhileOpen   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.net.TestNetworkTopology   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.TestHFlush   hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks   hadoop.hdfs.TestParallelUnixDomainRead   hadoop.cli.TestXAttrCLI   hadoop.hdfs.server.namenode.TestNameEditsConfigs   hadoop.hdfs.TestEncryptionZonesWithHA   hadoop.hdfs.server.datanode.TestRefreshNamenodes   hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy   hadoop.hdfs.TestFileCreationEmpty   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.qjournal.server.TestJournalNodeMXBean   hadoop.fs.contract.hdfs.TestHDFSContractRename   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   hadoop.fs.permission.TestStickyBit   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.TestDFSStartupVersions   hadoop.hdfs.TestFileCreation   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.TestMissingBlocksAlert   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   hadoop.hdfs.TestHDFSServerPorts   hadoop.hdfs.server.namenode.TestTransferFsImage   hadoop.hdfs.server.namenode.TestStartup   hadoop.hdfs.server.namenode.TestNameNodeRecovery   hadoop.hdfs.TestRead   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain   hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes   hadoop.hdfs.TestLocalDFS   hadoop.hdfs.qjournal.client.TestEpochsAreUnique   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.datanode.TestLargeBlockReport   hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   hadoop.hdfs.TestBlockReaderFactory   hadoop.hdfs.server.namenode.TestINodeAttributeProvider   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.hdfs.TestPipelines   hadoop.hdfs.TestReadStripedFileWithDecoding   hadoop.fs.loadGenerator.TestLoadGenerator   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.server.namenode.TestStripedINodeFile   hadoop.hdfs.TestListFilesInDFS   hadoop.cli.TestCacheAdminCLI   hadoop.fs.TestSWebHdfsFileContextMainOperations   hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.namenode.TestMetadataVersionOutput   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler   hadoop.fs.TestHDFSFileContextMainOperations   hadoop.hdfs.server.namenode.TestSaveNamespace   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped   hadoop.hdfs.server.datanode.TestDataNodeLifeline   hadoop.fs.TestGlobPaths   hadoop.fs.viewfs.TestViewFsFileStatusHdfs   hadoop.hdfs.server.namenode.TestMetaSave   hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens   hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.fs.viewfs.TestViewFsAtHdfsRoot   hadoop.TestGenericRefresh   hadoop.hdfs.server.datanode.TestIncrementalBrVariations   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.tools.TestGetGroups   hadoop.hdfs.server.namenode.TestBackupNode   hadoop.hdfs.server.namenode.TestNameNodeAcl   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.fs.shell.TestHdfsTextCommand   hadoop.hdfs.TestLargeBlock   hadoop.cli.TestDeleteCLI   hadoop.cli.TestHDFSCLI   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting   hadoop.fs.TestSymlinkHdfsDisable   hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   hadoop.hdfs.server.namenode.TestFSImage   hadoop.fs.viewfs.TestViewFileSystemHdfs   hadoop.hdfs.server.namenode.TestAddBlock   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.TestDFSInotifyEventInputStream   hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.hdfs.TestLease   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   hadoop.hdfs.server.namenode.TestCheckpoint   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   hadoop.hdfs.TestLeaseRecovery   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   org.apache.hadoop.hdfs.TestReplication   org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   org.apache.hadoop.hdfs.TestRollingUpgrade   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.TestClientReportBadBlock Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799971/HDFS-9958.003.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux d8cc76ce225b 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7da5847 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15238/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/15238/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15238/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 57s trunk passed
          +1 compile 0m 41s trunk passed with JDK v1.8.0_77
          +1 compile 0m 40s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 22s trunk passed
          +1 mvnsite 0m 51s trunk passed
          +1 mvneclipse 0m 14s trunk passed
          +1 findbugs 1m 55s trunk passed
          +1 javadoc 1m 8s trunk passed with JDK v1.8.0_77
          +1 javadoc 1m 49s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 47s the patch passed
          +1 compile 0m 38s the patch passed with JDK v1.8.0_77
          +1 javac 0m 38s the patch passed
          +1 compile 0m 40s the patch passed with JDK v1.7.0_95
          +1 javac 0m 40s the patch passed
          -1 checkstyle 0m 20s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130)
          +1 mvnsite 0m 49s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 7s the patch passed
          +1 javadoc 1m 10s the patch passed with JDK v1.8.0_77
          +1 javadoc 1m 51s the patch passed with JDK v1.7.0_95
          -1 unit 45m 30s hadoop-hdfs in the patch failed with JDK v1.8.0_77.
          -1 unit 42m 38s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 28s Patch does not generate ASF License warnings.
          114m 9s



          Reason Tests
          JDK v1.8.0_77 Failed junit tests hadoop.hdfs.TestReadStripedFileWithDecoding
            hadoop.hdfs.TestFileStatus
            hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
            hadoop.hdfs.server.namenode.TestINodeFile
            hadoop.fs.contract.hdfs.TestHDFSContractOpen
            hadoop.hdfs.server.datanode.TestFsDatasetCache
            hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
            hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
            hadoop.hdfs.TestFileCreationDelete
            hadoop.hdfs.server.namenode.ha.TestHASafeMode
            hadoop.hdfs.TestEncryptionZonesWithHA
            hadoop.fs.contract.hdfs.TestHDFSContractMkdir
            hadoop.hdfs.TestDFSShell
            hadoop.hdfs.server.namenode.TestNameNodeXAttr
            hadoop.hdfs.qjournal.TestMiniJournalCluster
            hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.TestDecommission
            hadoop.hdfs.TestDatanodeDeath
            hadoop.hdfs.server.namenode.TestFSEditLogLoader
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
            hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
            hadoop.hdfs.server.datanode.TestCachingStrategy
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.cli.TestXAttrCLI
            hadoop.hdfs.server.namenode.TestDeleteRace
            hadoop.hdfs.server.namenode.TestParallelImageWrite
            hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
            hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
            hadoop.hdfs.server.namenode.TestSaveNamespace
            hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks
            hadoop.hdfs.TestDFSRename
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
            hadoop.hdfs.server.datanode.TestDeleteBlockPool
            hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
            hadoop.hdfs.TestRemoteBlockReader2
            hadoop.hdfs.server.namenode.TestStorageRestore
            hadoop.hdfs.server.namenode.TestFileLimit
            hadoop.hdfs.server.blockmanagement.TestNodeCount
            hadoop.hdfs.TestEncryptionZones
            hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
            hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
            hadoop.hdfs.qjournal.TestNNWithQJM
            hadoop.hdfs.tools.TestDelegationTokenFetcher
            hadoop.hdfs.web.TestWebHdfsFileSystemContract
            hadoop.hdfs.TestDFSFinalize
            hadoop.hdfs.server.namenode.TestSecureNameNode
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140
            hadoop.hdfs.server.namenode.TestFileContextAcl
            hadoop.hdfs.TestDatanodeRegistration
            hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
            hadoop.hdfs.TestDataTransferProtocol
            hadoop.fs.viewfs.TestViewFsWithXAttrs
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000
            hadoop.hdfs.server.datanode.TestDiskError
            hadoop.hdfs.TestFsShellPermission
            hadoop.hdfs.server.namenode.TestMalformedURLs
            hadoop.hdfs.TestBalancerBandwidth
            hadoop.hdfs.TestReadWhileWriting
            hadoop.hdfs.qjournal.server.TestJournalNode
            hadoop.fs.TestSWebHdfsFileContextMainOperations
            hadoop.hdfs.TestWriteReadStripedFile
            hadoop.hdfs.TestDisableConnCache
            hadoop.hdfs.TestIsMethodSupported
            hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
            hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy
            hadoop.hdfs.TestFileCreationClient
            hadoop.hdfs.server.namenode.TestNameNodeReconfigure
            hadoop.cli.TestAclCLI
            hadoop.hdfs.TestFSOutputSummer
            hadoop.hdfs.TestErasureCodingPolicies
            hadoop.fs.TestHDFSFileContextMainOperations
            hadoop.hdfs.TestDFSStartupVersions
            hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
            hadoop.hdfs.TestParallelShortCircuitLegacyRead
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
            hadoop.hdfs.server.namenode.TestGenericJournalConf
            hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter
            hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.web.TestWebHdfsTimeouts
            hadoop.hdfs.TestFileAppend2
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
            hadoop.hdfs.server.datanode.TestTransferRbw
            hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
            hadoop.fs.contract.hdfs.TestHDFSContractSeek
            hadoop.hdfs.TestLocalDFS
            hadoop.hdfs.server.mover.TestStorageMover
            hadoop.hdfs.TestFileChecksum
            hadoop.hdfs.TestGetFileChecksum
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
            hadoop.hdfs.server.namenode.TestMetadataVersionOutput
            hadoop.hdfs.server.namenode.ha.TestHAAppend
            hadoop.hdfs.server.namenode.TestFSImageWithAcl
            hadoop.fs.TestUnbuffer
            hadoop.hdfs.TestDFSPermission
            hadoop.hdfs.TestParallelRead
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.server.namenode.TestAddBlock
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
            hadoop.hdfs.server.namenode.TestMetaSave
            hadoop.hdfs.TestSmallBlock
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.hdfs.web.TestHttpsFileSystem
            hadoop.tracing.TestTracing
            hadoop.cli.TestErasureCodingCLI
            hadoop.hdfs.TestBlockReaderLocal
            hadoop.hdfs.TestDFSStripedInputStream
            hadoop.hdfs.server.datanode.TestTriggerBlockReport
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
            hadoop.fs.contract.hdfs.TestHDFSContractConcat
            hadoop.hdfs.TestReplication
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.security.TestRefreshUserMappings
            hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
            hadoop.hdfs.server.mover.TestMover
            hadoop.hdfs.tools.TestDFSZKFailoverController
            hadoop.hdfs.server.namenode.TestHDFSConcat
            hadoop.hdfs.TestReadStripedFileWithMissingBlocks
            hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
            hadoop.hdfs.server.namenode.TestFSImageWithXAttr
            hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
            hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
            hadoop.hdfs.server.datanode.TestDataNodeLifeline
            hadoop.security.TestPermissionSymlinks
            hadoop.hdfs.TestHFlush
            hadoop.hdfs.server.namenode.TestDecommissioningStatus
            hadoop.fs.TestSymlinkHdfsDisable
            hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
            hadoop.hdfs.server.namenode.TestQuotaByStorageType
            hadoop.hdfs.TestFileCreation
            hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
            hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
            hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
            hadoop.fs.TestSymlinkHdfsFileContext
            hadoop.hdfs.qjournal.TestSecureNNWithQJM
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
            hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
            hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
            hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
            hadoop.hdfs.TestRollingUpgradeDowngrade
            hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
            hadoop.hdfs.TestBlockReaderFactory
            hadoop.hdfs.TestFetchImage
            hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
            hadoop.hdfs.TestDFSOutputStream
            hadoop.fs.TestUrlStreamHandler
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130
            hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200
            hadoop.hdfs.server.datanode.TestBatchIbr
            hadoop.hdfs.TestModTime
            hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
            hadoop.hdfs.TestFileStatusWithECPolicy
            hadoop.hdfs.TestAppendSnapshotTruncate
            hadoop.hdfs.tools.TestGetGroups
            hadoop.hdfs.server.namenode.TestNameNodeRecovery
            hadoop.hdfs.TestRestartDFS
            hadoop.hdfs.TestDistributedFileSystem
            hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
            hadoop.hdfs.TestInjectionForSimulatedStorage
            hadoop.hdfs.TestDFSStripedOutputStream
            hadoop.hdfs.TestMiniDFSCluster
            hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
            hadoop.hdfs.server.namenode.snapshot.TestSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.TestLease
            hadoop.hdfs.server.namenode.TestProtectedDirectories
            hadoop.hdfs.TestHdfsAdmin
            hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
            hadoop.hdfs.server.balancer.TestBalancer
            hadoop.hdfs.server.namenode.TestAuditLogs
            hadoop.hdfs.server.namenode.TestFileTruncate
            hadoop.fs.TestWebHdfsFileContextMainOperations
            hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
            hadoop.hdfs.TestDFSAddressConfig
            hadoop.fs.TestSymlinkHdfsFileSystem
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
            hadoop.tools.TestJMXGet
            hadoop.hdfs.server.namenode.TestEditLogJournalFailures
            hadoop.hdfs.TestDFSMkdirs
            hadoop.hdfs.TestWriteRead
            hadoop.hdfs.TestClientBlockVerification
            hadoop.fs.viewfs.TestViewFsDefaultValue
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
            hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
            hadoop.hdfs.TestDatanodeConfig
            hadoop.hdfs.TestDecommissionWithStriped
            hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
            hadoop.hdfs.server.namenode.TestAddStripedBlocks
            hadoop.hdfs.server.datanode.TestDataNodeECN
            hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.hdfs.qjournal.client.TestQuorumJournalManager
            hadoop.hdfs.server.datanode.TestDataNodeMXBean
            hadoop.hdfs.server.namenode.TestAclConfigFlag
            hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
            hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
            hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp
            hadoop.hdfs.TestReconstructStripedFile
            hadoop.hdfs.server.namenode.TestBackupNode
            hadoop.cli.TestHDFSCLI
            hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.hdfs.server.namenode.TestAllowFormat
            hadoop.hdfs.server.namenode.TestValidateConfigurationSettings
            hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
            hadoop.hdfs.server.namenode.TestNameNodeRpcServer
            hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
            hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
            hadoop.fs.contract.hdfs.TestHDFSContractDelete
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
            hadoop.hdfs.server.namenode.TestCheckpoint
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
            hadoop.hdfs.server.namenode.TestDeadDatanode
            hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
            hadoop.hdfs.TestDatanodeReport
            hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
            hadoop.hdfs.server.namenode.TestAuditLogger
            hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
            hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
            hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy
            hadoop.hdfs.TestDFSShellGenericOptions
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain
            hadoop.security.TestPermission
            hadoop.hdfs.web.TestWebHDFSAcl
            hadoop.hdfs.TestMissingBlocksAlert
            hadoop.fs.viewfs.TestViewFsHdfs
            hadoop.hdfs.TestClose
            hadoop.cli.TestDeleteCLI
            hadoop.hdfs.tools.TestDebugAdmin
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
            hadoop.fs.TestFcHdfsCreateMkdir
            hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
            hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
            hadoop.hdfs.server.datanode.TestDataNodeUUID
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.namenode.TestXAttrConfigFlag
            hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
            hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
            hadoop.fs.permission.TestStickyBit
            hadoop.hdfs.tools.TestDFSAdminWithHA
            hadoop.fs.viewfs.TestViewFsWithAcls
            hadoop.hdfs.tools.TestStoragePolicyCommands
            hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
            hadoop.hdfs.server.namenode.TestNestedEncryptionZones
            hadoop.hdfs.server.namenode.TestStartup
            hadoop.hdfs.TestMultiThreadedHflush
            hadoop.TestGenericRefresh
            hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            hadoop.hdfs.TestQuota
            hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050
            hadoop.fs.viewfs.TestViewFsAtHdfsRoot
            hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
            hadoop.hdfs.TestCrcCorruption
            hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
            hadoop.tracing.TestTracingShortCircuitLocalRead
            hadoop.fs.TestFcHdfsPermission
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
            hadoop.hdfs.TestLeaseRecovery
            hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
            hadoop.hdfs.TestFileLengthOnClusterRestart
            hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
            hadoop.fs.contract.hdfs.TestHDFSContractCreate
            hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.web.TestWebHDFS
            hadoop.hdfs.TestGetBlocks
            hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
            hadoop.hdfs.qjournal.server.TestJournalNodeMXBean
            hadoop.hdfs.server.namenode.TestNameNodeHttpServer
            hadoop.fs.TestResolveHdfsSymlink
            hadoop.hdfs.server.datanode.TestStorageReport
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
            hadoop.hdfs.TestDFSUpgrade
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.TestPread
            hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.server.namenode.TestNameNodeMXBean
            hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
            hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
            hadoop.tracing.TestTraceAdmin
            hadoop.hdfs.qjournal.client.TestEpochsAreUnique
            hadoop.hdfs.qjournal.client.TestQJMWithFaults
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
            hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
            hadoop.hdfs.TestErasureCodeBenchmarkThroughput
            hadoop.hdfs.server.namenode.TestNameEditsConfigs
            hadoop.cli.TestCacheAdminCLI
            hadoop.hdfs.server.datanode.TestDataNodeExit
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
            hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
            hadoop.hdfs.server.datanode.TestRefreshNamenodes
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
            hadoop.hdfs.web.TestWebHDFSForHA
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
            hadoop.hdfs.server.namenode.TestHostsFiles
            hadoop.hdfs.TestApplyingStoragePolicy
            hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
            hadoop.hdfs.web.TestFSMainOperationsWebHdfs
            hadoop.hdfs.server.namenode.TestEditLogRace
            hadoop.TestRefreshCallQueue
            hadoop.hdfs.TestSetTimes
            hadoop.hdfs.TestDFSUpgradeFromImage
            hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
            hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
            hadoop.hdfs.TestDFSClientSocketSize
            hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.fs.TestEnhancedByteBufferAccess
            hadoop.cli.TestCryptoAdminCLI
            hadoop.hdfs.TestClientProtocolForPipelineRecovery
            hadoop.hdfs.TestDFSStorageStateRecovery
            hadoop.hdfs.TestPersistBlocks
            hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
            hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
            hadoop.hdfs.TestListFilesInFileContext
            hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
            hadoop.hdfs.TestBlockMissingException
            hadoop.hdfs.server.namenode.TestSnapshotPathINodes
            hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2
            hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
            hadoop.fs.viewfs.TestViewFileSystemHdfs
            hadoop.hdfs.server.datanode.TestBlockRecovery
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
            hadoop.hdfs.security.TestDelegationToken
            hadoop.hdfs.server.namenode.TestBlockUnderConstruction
            hadoop.hdfs.TestFileConcurrentReader
            hadoop.hdfs.TestDFSClientRetries
            hadoop.hdfs.server.namenode.TestINodeAttributeProvider
            hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
            hadoop.hdfs.TestParallelShortCircuitReadUnCached
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020
            hadoop.hdfs.tools.TestDFSAdmin
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.hdfs.TestRead
            hadoop.hdfs.TestDFSInotifyEventInputStream
            hadoop.hdfs.server.datanode.TestDataNodeInitStorage
            hadoop.hdfs.server.namenode.TestFSNamesystemMBean
            hadoop.fs.loadGenerator.TestLoadGenerator
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
            hadoop.fs.contract.hdfs.TestHDFSContractAppend
            hadoop.hdfs.server.namenode.TestSecondaryWebUi
            hadoop.fs.viewfs.TestViewFileSystemWithAcls
            hadoop.hdfs.web.TestWebHDFSXAttr
            hadoop.hdfs.server.datanode.TestIncrementalBlockReports
            hadoop.hdfs.web.TestWebHdfsTokens
            hadoop.hdfs.TestSetrepIncreasing
            hadoop.fs.TestFcHdfsSetUMask
            hadoop.hdfs.TestLargeBlock
            hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
            hadoop.hdfs.TestFileAppend3
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks
            hadoop.hdfs.TestDFSClientFailover
            hadoop.hdfs.server.namenode.TestStripedINodeFile
            hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
            hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            hadoop.hdfs.TestLeaseRecoveryStriped
            hadoop.hdfs.security.TestClientProtocolWithDelegationToken
            hadoop.hdfs.server.namenode.ha.TestHAMetrics
            hadoop.hdfs.server.namenode.TestFSDirectory
            hadoop.hdfs.server.namenode.TestFSImage
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
            hadoop.hdfs.server.namenode.TestAddBlockRetry
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
            hadoop.hdfs.TestSafeModeWithStripedFile
            hadoop.hdfs.server.datanode.TestBlockScanner
            hadoop.hdfs.TestPipelines
            hadoop.hdfs.TestSetrepDecreasing
            hadoop.hdfs.TestAppendDifferentChecksum
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
            hadoop.hdfs.server.namenode.TestTransferFsImage
            hadoop.hdfs.server.namenode.ha.TestHAFsck
            hadoop.hdfs.TestSeekBug
            hadoop.hdfs.TestFileAppend4
            hadoop.hdfs.TestDFSRemove
            hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
            hadoop.hdfs.TestBlockReaderLocalLegacy
            hadoop.hdfs.TestBlocksScheduledCounter
            hadoop.hdfs.TestExternalBlockReader
            hadoop.fs.viewfs.TestViewFsFileStatusHdfs
            hadoop.hdfs.TestAclsEndToEnd
            hadoop.hdfs.TestSnapshotCommands
            hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
            hadoop.fs.shell.TestHdfsTextCommand
            hadoop.hdfs.TestWriteConfigurationToDFS
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
            hadoop.hdfs.server.datanode.TestLargeBlockReport
            hadoop.hdfs.TestDFSRollback
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
            hadoop.hdfs.TestFSInputChecker
            hadoop.hdfs.TestParallelShortCircuitRead
            hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
            hadoop.fs.TestGlobPaths
            hadoop.hdfs.TestDataTransferKeepalive
            hadoop.hdfs.TestHDFSTrash
            hadoop.hdfs.server.namenode.TestNameNodeAcl
            hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
            hadoop.fs.contract.hdfs.TestHDFSContractRename
            hadoop.hdfs.TestHDFSServerPorts
            hadoop.hdfs.TestRenameWhileOpen
            hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
            hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
            hadoop.hdfs.TestEncryptedTransfer
            hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
            hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger
            hadoop.hdfs.TestHDFSFileSystemContract
            hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
            hadoop.net.TestNetworkTopology
            hadoop.hdfs.security.token.block.TestBlockToken
            hadoop.hdfs.server.datanode.TestIncrementalBrVariations
            hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
            hadoop.hdfs.server.datanode.TestHSync
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
            hadoop.hdfs.server.namenode.TestNamenodeRetryCache
            hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.server.namenode.TestCreateEditsLog
            hadoop.hdfs.server.namenode.TestFileContextXAttr
          JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
            org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            org.apache.hadoop.hdfs.TestRollingUpgrade
            org.apache.hadoop.hdfs.TestRollingUpgradeRollback
            org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
            org.apache.hadoop.hdfs.TestClientReportBadBlock
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestReadStripedFileWithDecoding
            hadoop.hdfs.TestFileStatus
            hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
            hadoop.hdfs.server.namenode.TestINodeFile
            hadoop.fs.contract.hdfs.TestHDFSContractOpen
            hadoop.hdfs.server.datanode.TestFsDatasetCache
            hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
            hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
            hadoop.hdfs.TestFileCreationDelete
            hadoop.hdfs.server.namenode.ha.TestHASafeMode
            hadoop.hdfs.TestEncryptionZonesWithHA
            hadoop.fs.contract.hdfs.TestHDFSContractMkdir
            hadoop.hdfs.TestDFSShell
            hadoop.hdfs.server.namenode.TestNameNodeXAttr
            hadoop.hdfs.qjournal.TestMiniJournalCluster
            hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.TestDecommission
            hadoop.hdfs.TestDatanodeDeath
            hadoop.hdfs.server.namenode.TestFSEditLogLoader
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
            hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
            hadoop.hdfs.server.datanode.TestCachingStrategy
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.cli.TestXAttrCLI
            hadoop.hdfs.server.namenode.TestDeleteRace
            hadoop.hdfs.server.namenode.TestParallelImageWrite
            hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
            hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
            hadoop.hdfs.server.namenode.TestSaveNamespace
            hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks
            hadoop.hdfs.TestDFSRename
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
            hadoop.hdfs.TestFileCreationEmpty
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
            hadoop.hdfs.server.datanode.TestDeleteBlockPool
            hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
            hadoop.hdfs.TestRemoteBlockReader2
            hadoop.hdfs.server.namenode.TestStorageRestore
            hadoop.hdfs.server.namenode.TestFileLimit
            hadoop.hdfs.server.blockmanagement.TestNodeCount
            hadoop.hdfs.TestEncryptionZones
            hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
            hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
            hadoop.hdfs.qjournal.TestNNWithQJM
            hadoop.hdfs.tools.TestDelegationTokenFetcher
            hadoop.hdfs.web.TestWebHdfsFileSystemContract
            hadoop.hdfs.TestDFSFinalize
            hadoop.hdfs.server.namenode.TestSecureNameNode
            hadoop.hdfs.server.namenode.TestFileContextAcl
            hadoop.hdfs.TestDatanodeRegistration
            hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
            hadoop.hdfs.TestDataTransferProtocol
            hadoop.fs.viewfs.TestViewFsWithXAttrs
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000
            hadoop.hdfs.server.datanode.TestDiskError
            hadoop.hdfs.TestFsShellPermission
            hadoop.hdfs.server.namenode.TestMalformedURLs
            hadoop.hdfs.TestBalancerBandwidth
            hadoop.hdfs.TestReadWhileWriting
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100
            hadoop.hdfs.qjournal.server.TestJournalNode
            hadoop.fs.TestSWebHdfsFileContextMainOperations
            hadoop.hdfs.TestWriteReadStripedFile
            hadoop.hdfs.TestDisableConnCache
            hadoop.hdfs.TestIsMethodSupported
            hadoop.hdfs.TestDFSClientExcludedNodes
            hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
            hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy
            hadoop.hdfs.TestFileCreationClient
            hadoop.hdfs.server.namenode.TestNameNodeReconfigure
            hadoop.cli.TestAclCLI
            hadoop.hdfs.TestFSOutputSummer
            hadoop.hdfs.TestErasureCodingPolicies
            hadoop.fs.TestHDFSFileContextMainOperations
            hadoop.hdfs.TestDFSStartupVersions
            hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
            hadoop.hdfs.TestParallelShortCircuitLegacyRead
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
            hadoop.hdfs.server.namenode.TestGenericJournalConf
            hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter
            hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.web.TestWebHdfsTimeouts
            hadoop.hdfs.TestFileAppend2
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
            hadoop.hdfs.TestParallelUnixDomainRead
            hadoop.hdfs.server.datanode.TestTransferRbw
            hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
            hadoop.fs.contract.hdfs.TestHDFSContractSeek
            hadoop.hdfs.TestLocalDFS
            hadoop.hdfs.server.mover.TestStorageMover
            hadoop.hdfs.TestFileChecksum
            hadoop.hdfs.TestGetFileChecksum
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
            hadoop.hdfs.server.namenode.TestMetadataVersionOutput
            hadoop.hdfs.server.namenode.ha.TestHAAppend
            hadoop.hdfs.server.namenode.TestFSImageWithAcl
            hadoop.fs.TestUnbuffer
            hadoop.hdfs.TestDFSPermission
            hadoop.hdfs.TestParallelRead
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.server.namenode.TestAddBlock
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
            hadoop.hdfs.server.namenode.TestMetaSave
            hadoop.hdfs.TestSmallBlock
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.hdfs.web.TestHttpsFileSystem
            hadoop.tracing.TestTracing
            hadoop.hdfs.TestListFilesInDFS
            hadoop.cli.TestErasureCodingCLI
            hadoop.hdfs.TestFileAppendRestart
            hadoop.hdfs.TestBlockReaderLocal
            hadoop.hdfs.TestDFSStripedInputStream
            hadoop.hdfs.server.datanode.TestTriggerBlockReport
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
            hadoop.fs.contract.hdfs.TestHDFSContractConcat
            hadoop.hdfs.TestReplication
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.security.TestRefreshUserMappings
            hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
            hadoop.hdfs.server.mover.TestMover
            hadoop.hdfs.TestSafeMode
            hadoop.hdfs.tools.TestDFSZKFailoverController
            hadoop.hdfs.server.namenode.TestHDFSConcat
            hadoop.hdfs.TestReadStripedFileWithMissingBlocks
            hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
            hadoop.hdfs.server.namenode.TestFSImageWithXAttr
            hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
            hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
            hadoop.hdfs.server.datanode.TestDataNodeLifeline
            hadoop.security.TestPermissionSymlinks
            hadoop.hdfs.TestHFlush
            hadoop.hdfs.server.namenode.TestDecommissioningStatus
            hadoop.fs.TestSymlinkHdfsDisable
            hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
            hadoop.hdfs.server.namenode.TestQuotaByStorageType
            hadoop.hdfs.TestFileCreation
            hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
            hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
            hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
            hadoop.fs.TestSymlinkHdfsFileContext
            hadoop.hdfs.qjournal.TestSecureNNWithQJM
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
            hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
            hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
            hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
            hadoop.hdfs.TestRollingUpgradeDowngrade
            hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
            hadoop.hdfs.TestBlockReaderFactory
            hadoop.hdfs.TestRemoteBlockReader
            hadoop.hdfs.TestFetchImage
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010
            hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
            hadoop.hdfs.TestDFSOutputStream
            hadoop.fs.TestUrlStreamHandler
            hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200
            hadoop.hdfs.server.datanode.TestBatchIbr
            hadoop.hdfs.TestModTime
            hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
            hadoop.hdfs.TestFileStatusWithECPolicy
            hadoop.hdfs.TestAppendSnapshotTruncate
            hadoop.hdfs.tools.TestGetGroups
            hadoop.hdfs.server.namenode.TestNameNodeRecovery
            hadoop.hdfs.TestRestartDFS
            hadoop.hdfs.TestDistributedFileSystem
            hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
            hadoop.hdfs.TestInjectionForSimulatedStorage
            hadoop.hdfs.TestDFSStripedOutputStream
            hadoop.hdfs.TestMiniDFSCluster
            hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
            hadoop.hdfs.server.namenode.snapshot.TestSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.TestLease
            hadoop.hdfs.server.namenode.TestProtectedDirectories
            hadoop.hdfs.TestHdfsAdmin
            hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
            hadoop.hdfs.server.balancer.TestBalancer
            hadoop.hdfs.server.namenode.TestAuditLogs
            hadoop.hdfs.server.namenode.TestFileTruncate
            hadoop.fs.TestWebHdfsFileContextMainOperations
            hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
            hadoop.hdfs.TestDFSAddressConfig
            hadoop.fs.TestSymlinkHdfsFileSystem
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
            hadoop.tools.TestJMXGet
            hadoop.hdfs.server.namenode.TestEditLogJournalFailures
            hadoop.hdfs.TestDFSMkdirs
            hadoop.hdfs.TestWriteRead
            hadoop.hdfs.TestClientBlockVerification
            hadoop.fs.viewfs.TestViewFsDefaultValue
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
            hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
            hadoop.hdfs.TestDatanodeConfig
            hadoop.hdfs.TestDecommissionWithStriped
            hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
            hadoop.hdfs.server.namenode.TestAddStripedBlocks
            hadoop.hdfs.server.datanode.TestDataNodeECN
            hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.hdfs.qjournal.client.TestQuorumJournalManager
            hadoop.hdfs.server.datanode.TestDataNodeMXBean
            hadoop.hdfs.server.namenode.TestAclConfigFlag
            hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
            hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
            hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp
            hadoop.hdfs.TestReconstructStripedFile
            hadoop.hdfs.server.namenode.TestBackupNode
            hadoop.cli.TestHDFSCLI
            hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.hdfs.server.namenode.TestAllowFormat
            hadoop.hdfs.server.namenode.TestValidateConfigurationSettings
            hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
            hadoop.hdfs.server.namenode.TestNameNodeRpcServer
            hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
            hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
            hadoop.fs.contract.hdfs.TestHDFSContractDelete
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
            hadoop.hdfs.server.namenode.TestCheckpoint
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
            hadoop.hdfs.server.namenode.TestDeadDatanode
            hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
            hadoop.hdfs.TestDatanodeReport
            hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
            hadoop.hdfs.TestClientReportBadBlock
            hadoop.hdfs.server.namenode.TestAuditLogger
            hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
            hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
            hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy
            hadoop.hdfs.TestDFSShellGenericOptions
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain
            hadoop.security.TestPermission
            hadoop.hdfs.web.TestWebHDFSAcl
            hadoop.hdfs.TestMissingBlocksAlert
            hadoop.fs.viewfs.TestViewFsHdfs
            hadoop.hdfs.TestClose
            hadoop.cli.TestDeleteCLI
            hadoop.hdfs.tools.TestDebugAdmin
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
            hadoop.fs.TestFcHdfsCreateMkdir
            hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
            hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
            hadoop.hdfs.server.datanode.TestDataNodeUUID
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.namenode.TestXAttrConfigFlag
            hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
            hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
            hadoop.fs.permission.TestStickyBit
            hadoop.hdfs.tools.TestDFSAdminWithHA
            hadoop.fs.viewfs.TestViewFsWithAcls
            hadoop.hdfs.tools.TestStoragePolicyCommands
            hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
            hadoop.hdfs.server.namenode.TestNestedEncryptionZones
            hadoop.hdfs.server.namenode.TestStartup
            hadoop.hdfs.TestMultiThreadedHflush
            hadoop.TestGenericRefresh
            hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            hadoop.hdfs.TestQuota
            hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
            hadoop.hdfs.TestConnCache
            hadoop.fs.viewfs.TestViewFsAtHdfsRoot
            hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
            hadoop.hdfs.TestCrcCorruption
            hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
            hadoop.tracing.TestTracingShortCircuitLocalRead
            hadoop.fs.TestFcHdfsPermission
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
            hadoop.hdfs.TestLeaseRecovery
            hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
            hadoop.hdfs.TestFileLengthOnClusterRestart
            hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
            hadoop.fs.contract.hdfs.TestHDFSContractCreate
            hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.web.TestWebHDFS
            hadoop.hdfs.TestGetBlocks
            hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
            hadoop.hdfs.qjournal.server.TestJournalNodeMXBean
            hadoop.hdfs.server.namenode.TestNameNodeHttpServer
            hadoop.fs.TestResolveHdfsSymlink
            hadoop.hdfs.server.datanode.TestStorageReport
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
            hadoop.hdfs.TestDFSUpgrade
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.TestPread
            hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.server.namenode.TestNameNodeMXBean
            hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
            hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
            hadoop.tracing.TestTraceAdmin
            hadoop.hdfs.qjournal.client.TestEpochsAreUnique
            hadoop.hdfs.qjournal.client.TestQJMWithFaults
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
            hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
            hadoop.hdfs.TestErasureCodeBenchmarkThroughput
            hadoop.hdfs.server.namenode.TestNameEditsConfigs
            hadoop.cli.TestCacheAdminCLI
            hadoop.hdfs.server.datanode.TestDataNodeExit
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
            hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
            hadoop.hdfs.server.datanode.TestRefreshNamenodes
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
            hadoop.hdfs.web.TestWebHDFSForHA
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
            hadoop.hdfs.server.namenode.TestHostsFiles
            hadoop.hdfs.TestApplyingStoragePolicy
            hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
            hadoop.hdfs.web.TestFSMainOperationsWebHdfs
            hadoop.hdfs.server.namenode.TestEditLogRace
            hadoop.hdfs.TestReservedRawPaths
            hadoop.TestRefreshCallQueue
            hadoop.hdfs.TestSetTimes
            hadoop.hdfs.TestDFSUpgradeFromImage
            hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
            hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
            hadoop.hdfs.TestDFSClientSocketSize
            hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.fs.TestEnhancedByteBufferAccess
            hadoop.cli.TestCryptoAdminCLI
            hadoop.hdfs.TestClientProtocolForPipelineRecovery
            hadoop.hdfs.TestDFSStorageStateRecovery
            hadoop.hdfs.TestPersistBlocks
            hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
            hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
            hadoop.hdfs.TestListFilesInFileContext
            hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
            hadoop.hdfs.TestBlockMissingException
            hadoop.hdfs.server.namenode.TestSnapshotPathINodes
            hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2
            hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
            hadoop.fs.viewfs.TestViewFileSystemHdfs
            hadoop.hdfs.server.datanode.TestBlockRecovery
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
            hadoop.hdfs.security.TestDelegationToken
            hadoop.hdfs.server.namenode.TestBlockUnderConstruction
            hadoop.hdfs.TestFileConcurrentReader
            hadoop.hdfs.TestDFSClientRetries
            hadoop.hdfs.server.namenode.TestINodeAttributeProvider
            hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
            hadoop.hdfs.TestParallelShortCircuitReadUnCached
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020
            hadoop.hdfs.tools.TestDFSAdmin
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.hdfs.crypto.TestHdfsCryptoStreams
            hadoop.hdfs.TestRead
            hadoop.hdfs.TestDFSInotifyEventInputStream
            hadoop.hdfs.server.datanode.TestDataNodeInitStorage
            hadoop.hdfs.server.namenode.TestFSNamesystemMBean
            hadoop.fs.loadGenerator.TestLoadGenerator
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
            hadoop.fs.contract.hdfs.TestHDFSContractAppend
            hadoop.hdfs.server.namenode.TestSecondaryWebUi
            hadoop.fs.viewfs.TestViewFileSystemWithAcls
            hadoop.hdfs.web.TestWebHDFSXAttr
            hadoop.hdfs.server.datanode.TestIncrementalBlockReports
            hadoop.hdfs.web.TestWebHdfsTokens
            hadoop.hdfs.TestSetrepIncreasing
            hadoop.fs.TestFcHdfsSetUMask
            hadoop.hdfs.TestLargeBlock
            hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
            hadoop.hdfs.TestFileAppend3
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks
            hadoop.hdfs.TestDFSClientFailover
            hadoop.hdfs.server.namenode.TestStripedINodeFile
            hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
            hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            hadoop.hdfs.TestLeaseRecoveryStriped
            hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
            hadoop.hdfs.security.TestClientProtocolWithDelegationToken
            hadoop.hdfs.server.namenode.ha.TestHAMetrics
            hadoop.hdfs.server.namenode.TestFSDirectory
            hadoop.hdfs.server.namenode.TestFSImage
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
            hadoop.hdfs.server.namenode.TestAddBlockRetry
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
            hadoop.hdfs.TestSafeModeWithStripedFile
            hadoop.hdfs.server.datanode.TestBlockScanner
            hadoop.hdfs.TestPipelines
            hadoop.hdfs.TestSetrepDecreasing
            hadoop.hdfs.TestAppendDifferentChecksum
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
            hadoop.hdfs.server.namenode.TestTransferFsImage
            hadoop.hdfs.server.namenode.ha.TestHAFsck
            hadoop.hdfs.TestSeekBug
            hadoop.hdfs.TestFileAppend4
            hadoop.hdfs.TestDFSRemove
            hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
            hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
            hadoop.hdfs.TestBlockReaderLocalLegacy
            hadoop.hdfs.TestBlocksScheduledCounter
            hadoop.hdfs.TestExternalBlockReader
            hadoop.fs.viewfs.TestViewFsFileStatusHdfs
            hadoop.hdfs.TestAclsEndToEnd
            hadoop.hdfs.TestSnapshotCommands
            hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
            hadoop.fs.shell.TestHdfsTextCommand
            hadoop.hdfs.TestWriteConfigurationToDFS
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
            hadoop.hdfs.server.datanode.TestLargeBlockReport
            hadoop.hdfs.TestDFSRollback
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
            hadoop.hdfs.TestFSInputChecker
            hadoop.hdfs.TestParallelShortCircuitRead
            hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
            hadoop.hdfs.TestAbandonBlock
            hadoop.fs.TestGlobPaths
            hadoop.hdfs.TestDataTransferKeepalive
            hadoop.hdfs.TestHDFSTrash
            hadoop.hdfs.server.namenode.TestNameNodeAcl
            hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
            hadoop.fs.contract.hdfs.TestHDFSContractRename
            hadoop.hdfs.TestDFSInputStream
            hadoop.hdfs.TestHDFSServerPorts
            hadoop.hdfs.TestRenameWhileOpen
            hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
            hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
            hadoop.hdfs.TestEncryptedTransfer
            hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
            hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger
            hadoop.hdfs.TestHDFSFileSystemContract
            hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
            hadoop.net.TestNetworkTopology
            hadoop.hdfs.security.token.block.TestBlockToken
            hadoop.hdfs.server.datanode.TestIncrementalBrVariations
            hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
            hadoop.hdfs.server.datanode.TestHSync
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
            hadoop.hdfs.server.namenode.TestNamenodeRetryCache
            hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
            hadoop.hdfs.TestDatanodeLayoutUpgrade
            hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.server.namenode.TestCreateEditsLog
            hadoop.hdfs.server.namenode.TestFileContextXAttr
          JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
            org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            org.apache.hadoop.hdfs.TestRollingUpgrade
            org.apache.hadoop.hdfs.TestRollingUpgradeRollback
            org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
            org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799971/HDFS-9958.003.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 1af5b41854dc 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / a749ba0
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15244/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15244/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 57s trunk passed +1 compile 0m 41s trunk passed with JDK v1.8.0_77 +1 compile 0m 40s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 22s trunk passed +1 mvnsite 0m 51s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 55s trunk passed +1 javadoc 1m 8s trunk passed with JDK v1.8.0_77 +1 javadoc 1m 49s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 47s the patch passed +1 compile 0m 38s the patch passed with JDK v1.8.0_77 +1 javac 0m 38s the patch passed +1 compile 0m 40s the patch passed with JDK v1.7.0_95 +1 javac 0m 40s the patch passed -1 checkstyle 0m 20s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130) +1 mvnsite 0m 49s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 7s the patch passed +1 javadoc 1m 10s the patch passed with JDK v1.8.0_77 +1 javadoc 1m 51s the patch passed with JDK v1.7.0_95 -1 unit 45m 30s hadoop-hdfs in the patch failed with JDK v1.8.0_77. -1 unit 42m 38s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 28s Patch does not generate ASF License warnings. 114m 9s Reason Tests JDK v1.8.0_77 Failed junit tests hadoop.hdfs.TestReadStripedFileWithDecoding   hadoop.hdfs.TestFileStatus   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.fs.contract.hdfs.TestHDFSContractOpen   hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.TestEncryptionZonesWithHA   hadoop.fs.contract.hdfs.TestHDFSContractMkdir   hadoop.hdfs.TestDFSShell   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.qjournal.TestMiniJournalCluster   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.TestDecommission   hadoop.hdfs.TestDatanodeDeath   hadoop.hdfs.server.namenode.TestFSEditLogLoader   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.server.datanode.TestCachingStrategy   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.cli.TestXAttrCLI   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.server.namenode.TestParallelImageWrite   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional   hadoop.hdfs.server.namenode.TestSaveNamespace   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks   hadoop.hdfs.TestDFSRename   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods   hadoop.hdfs.TestRemoteBlockReader2   hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.server.namenode.TestFileLimit   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.TestEncryptionZones   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes   hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots   hadoop.hdfs.qjournal.TestNNWithQJM   hadoop.hdfs.tools.TestDelegationTokenFetcher   hadoop.hdfs.web.TestWebHdfsFileSystemContract   hadoop.hdfs.TestDFSFinalize   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140   hadoop.hdfs.server.namenode.TestFileContextAcl   hadoop.hdfs.TestDatanodeRegistration   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.TestDataTransferProtocol   hadoop.fs.viewfs.TestViewFsWithXAttrs   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000   hadoop.hdfs.server.datanode.TestDiskError   hadoop.hdfs.TestFsShellPermission   hadoop.hdfs.server.namenode.TestMalformedURLs   hadoop.hdfs.TestBalancerBandwidth   hadoop.hdfs.TestReadWhileWriting   hadoop.hdfs.qjournal.server.TestJournalNode   hadoop.fs.TestSWebHdfsFileContextMainOperations   hadoop.hdfs.TestWriteReadStripedFile   hadoop.hdfs.TestDisableConnCache   hadoop.hdfs.TestIsMethodSupported   hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy   hadoop.hdfs.TestFileCreationClient   hadoop.hdfs.server.namenode.TestNameNodeReconfigure   hadoop.cli.TestAclCLI   hadoop.hdfs.TestFSOutputSummer   hadoop.hdfs.TestErasureCodingPolicies   hadoop.fs.TestHDFSFileContextMainOperations   hadoop.hdfs.TestDFSStartupVersions   hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.TestParallelShortCircuitLegacyRead   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure   hadoop.hdfs.server.namenode.TestGenericJournalConf   hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.web.TestWebHdfsTimeouts   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.fs.contract.hdfs.TestHDFSContractSeek   hadoop.hdfs.TestLocalDFS   hadoop.hdfs.server.mover.TestStorageMover   hadoop.hdfs.TestFileChecksum   hadoop.hdfs.TestGetFileChecksum   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.hdfs.server.namenode.TestMetadataVersionOutput   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.fs.TestUnbuffer   hadoop.hdfs.TestDFSPermission   hadoop.hdfs.TestParallelRead   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.server.namenode.TestAddBlock   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   hadoop.hdfs.server.namenode.TestMetaSave   hadoop.hdfs.TestSmallBlock   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.web.TestHttpsFileSystem   hadoop.tracing.TestTracing   hadoop.cli.TestErasureCodingCLI   hadoop.hdfs.TestBlockReaderLocal   hadoop.hdfs.TestDFSStripedInputStream   hadoop.hdfs.server.datanode.TestTriggerBlockReport   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.fs.contract.hdfs.TestHDFSContractConcat   hadoop.hdfs.TestReplication   hadoop.hdfs.server.namenode.TestEditLog   hadoop.security.TestRefreshUserMappings   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.hdfs.server.mover.TestMover   hadoop.hdfs.tools.TestDFSZKFailoverController   hadoop.hdfs.server.namenode.TestHDFSConcat   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs   hadoop.hdfs.server.datanode.TestDataNodeLifeline   hadoop.security.TestPermissionSymlinks   hadoop.hdfs.TestHFlush   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.fs.TestSymlinkHdfsDisable   hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.TestFileCreation   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.qjournal.TestSecureNNWithQJM   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   hadoop.hdfs.TestRollingUpgradeDowngrade   hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   hadoop.hdfs.TestBlockReaderFactory   hadoop.hdfs.TestFetchImage   hadoop.hdfs.server.namenode.TestReconstructStripedBlocks   hadoop.hdfs.TestDFSOutputStream   hadoop.fs.TestUrlStreamHandler   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200   hadoop.hdfs.server.datanode.TestBatchIbr   hadoop.hdfs.TestModTime   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs   hadoop.hdfs.TestFileStatusWithECPolicy   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.tools.TestGetGroups   hadoop.hdfs.server.namenode.TestNameNodeRecovery   hadoop.hdfs.TestRestartDFS   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   hadoop.hdfs.TestInjectionForSimulatedStorage   hadoop.hdfs.TestDFSStripedOutputStream   hadoop.hdfs.TestMiniDFSCluster   hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.TestLease   hadoop.hdfs.server.namenode.TestProtectedDirectories   hadoop.hdfs.TestHdfsAdmin   hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot   hadoop.hdfs.server.balancer.TestBalancer   hadoop.hdfs.server.namenode.TestAuditLogs   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.fs.TestWebHdfsFileContextMainOperations   hadoop.hdfs.server.namenode.ha.TestNNHealthCheck   hadoop.hdfs.TestDFSAddressConfig   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.tools.TestJMXGet   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.TestDFSMkdirs   hadoop.hdfs.TestWriteRead   hadoop.hdfs.TestClientBlockVerification   hadoop.fs.viewfs.TestViewFsDefaultValue   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   hadoop.hdfs.TestDatanodeConfig   hadoop.hdfs.TestDecommissionWithStriped   hadoop.hdfs.server.namenode.TestNameNodeResourceChecker   hadoop.hdfs.server.namenode.TestAddStripedBlocks   hadoop.hdfs.server.datanode.TestDataNodeECN   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.hdfs.qjournal.client.TestQuorumJournalManager   hadoop.hdfs.server.datanode.TestDataNodeMXBean   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.server.namenode.TestBackupNode   hadoop.cli.TestHDFSCLI   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.server.namenode.TestAllowFormat   hadoop.hdfs.server.namenode.TestValidateConfigurationSettings   hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   hadoop.hdfs.server.namenode.TestNameNodeRpcServer   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   hadoop.fs.contract.hdfs.TestHDFSContractDelete   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.server.namenode.TestCheckpoint   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.hdfs.server.namenode.TestDeadDatanode   hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter   hadoop.hdfs.TestDatanodeReport   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA   hadoop.hdfs.server.namenode.TestNNThroughputBenchmark   hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy   hadoop.hdfs.TestDFSShellGenericOptions   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain   hadoop.security.TestPermission   hadoop.hdfs.web.TestWebHDFSAcl   hadoop.hdfs.TestMissingBlocksAlert   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.hdfs.TestClose   hadoop.cli.TestDeleteCLI   hadoop.hdfs.tools.TestDebugAdmin   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.fs.TestFcHdfsCreateMkdir   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.TestErasureCodingPolicyWithSnapshot   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.namenode.TestXAttrConfigFlag   hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy   hadoop.fs.permission.TestStickyBit   hadoop.hdfs.tools.TestDFSAdminWithHA   hadoop.fs.viewfs.TestViewFsWithAcls   hadoop.hdfs.tools.TestStoragePolicyCommands   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   hadoop.hdfs.server.namenode.TestNestedEncryptionZones   hadoop.hdfs.server.namenode.TestStartup   hadoop.hdfs.TestMultiThreadedHflush   hadoop.TestGenericRefresh   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   hadoop.hdfs.TestQuota   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050   hadoop.fs.viewfs.TestViewFsAtHdfsRoot   hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.TestCrcCorruption   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.tracing.TestTracingShortCircuitLocalRead   hadoop.fs.TestFcHdfsPermission   hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   hadoop.hdfs.TestLeaseRecovery   hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics   hadoop.hdfs.TestFileLengthOnClusterRestart   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory   hadoop.fs.contract.hdfs.TestHDFSContractCreate   hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN   hadoop.hdfs.TestFileAppend   hadoop.hdfs.web.TestWebHDFS   hadoop.hdfs.TestGetBlocks   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.qjournal.server.TestJournalNodeMXBean   hadoop.hdfs.server.namenode.TestNameNodeHttpServer   hadoop.fs.TestResolveHdfsSymlink   hadoop.hdfs.server.datanode.TestStorageReport   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl   hadoop.hdfs.TestDFSUpgrade   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.TestPread   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.tracing.TestTraceAdmin   hadoop.hdfs.qjournal.client.TestEpochsAreUnique   hadoop.hdfs.qjournal.client.TestQJMWithFaults   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.hdfs.server.namenode.TestNameEditsConfigs   hadoop.cli.TestCacheAdminCLI   hadoop.hdfs.server.datanode.TestDataNodeExit   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.server.datanode.TestRefreshNamenodes   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   hadoop.hdfs.web.TestWebHDFSForHA   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   hadoop.hdfs.server.namenode.TestHostsFiles   hadoop.hdfs.TestApplyingStoragePolicy   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength   hadoop.hdfs.web.TestFSMainOperationsWebHdfs   hadoop.hdfs.server.namenode.TestEditLogRace   hadoop.TestRefreshCallQueue   hadoop.hdfs.TestSetTimes   hadoop.hdfs.TestDFSUpgradeFromImage   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   hadoop.hdfs.TestDFSClientSocketSize   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.fs.TestEnhancedByteBufferAccess   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.TestClientProtocolForPipelineRecovery   hadoop.hdfs.TestDFSStorageStateRecovery   hadoop.hdfs.TestPersistBlocks   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.TestListFilesInFileContext   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   hadoop.hdfs.TestBlockMissingException   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.fs.viewfs.TestViewFileSystemHdfs   hadoop.hdfs.server.datanode.TestBlockRecovery   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.tools.TestDFSHAAdminMiniCluster   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.server.namenode.TestBlockUnderConstruction   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.TestDFSClientRetries   hadoop.hdfs.server.namenode.TestINodeAttributeProvider   hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens   hadoop.hdfs.TestParallelShortCircuitReadUnCached   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020   hadoop.hdfs.tools.TestDFSAdmin   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.TestRead   hadoop.hdfs.TestDFSInotifyEventInputStream   hadoop.hdfs.server.datanode.TestDataNodeInitStorage   hadoop.hdfs.server.namenode.TestFSNamesystemMBean   hadoop.fs.loadGenerator.TestLoadGenerator   hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId   hadoop.fs.contract.hdfs.TestHDFSContractAppend   hadoop.hdfs.server.namenode.TestSecondaryWebUi   hadoop.fs.viewfs.TestViewFileSystemWithAcls   hadoop.hdfs.web.TestWebHDFSXAttr   hadoop.hdfs.server.datanode.TestIncrementalBlockReports   hadoop.hdfs.web.TestWebHdfsTokens   hadoop.hdfs.TestSetrepIncreasing   hadoop.fs.TestFcHdfsSetUMask   hadoop.hdfs.TestLargeBlock   hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler   hadoop.hdfs.TestFileAppend3   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks   hadoop.hdfs.TestDFSClientFailover   hadoop.hdfs.server.namenode.TestStripedINodeFile   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.security.TestClientProtocolWithDelegationToken   hadoop.hdfs.server.namenode.ha.TestHAMetrics   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.hdfs.server.namenode.TestFSImage   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   hadoop.hdfs.server.namenode.TestAddBlockRetry   hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs   hadoop.hdfs.TestSafeModeWithStripedFile   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.TestPipelines   hadoop.hdfs.TestSetrepDecreasing   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.hdfs.server.namenode.TestTransferFsImage   hadoop.hdfs.server.namenode.ha.TestHAFsck   hadoop.hdfs.TestSeekBug   hadoop.hdfs.TestFileAppend4   hadoop.hdfs.TestDFSRemove   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.TestBlockReaderLocalLegacy   hadoop.hdfs.TestBlocksScheduledCounter   hadoop.hdfs.TestExternalBlockReader   hadoop.fs.viewfs.TestViewFsFileStatusHdfs   hadoop.hdfs.TestAclsEndToEnd   hadoop.hdfs.TestSnapshotCommands   hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize   hadoop.fs.shell.TestHdfsTextCommand   hadoop.hdfs.TestWriteConfigurationToDFS   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030   hadoop.hdfs.server.datanode.TestLargeBlockReport   hadoop.hdfs.TestDFSRollback   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot   hadoop.hdfs.TestFSInputChecker   hadoop.hdfs.TestParallelShortCircuitRead   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.fs.TestGlobPaths   hadoop.hdfs.TestDataTransferKeepalive   hadoop.hdfs.TestHDFSTrash   hadoop.hdfs.server.namenode.TestNameNodeAcl   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   hadoop.fs.contract.hdfs.TestHDFSContractRename   hadoop.hdfs.TestHDFSServerPorts   hadoop.hdfs.TestRenameWhileOpen   hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   hadoop.hdfs.server.datanode.TestDataNodeReconfiguration   hadoop.hdfs.TestEncryptedTransfer   hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger   hadoop.hdfs.TestHDFSFileSystemContract   hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.net.TestNetworkTopology   hadoop.hdfs.security.token.block.TestBlockToken   hadoop.hdfs.server.datanode.TestIncrementalBrVariations   hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness   hadoop.hdfs.server.datanode.TestHSync   hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.TestCreateEditsLog   hadoop.hdfs.server.namenode.TestFileContextXAttr JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   org.apache.hadoop.hdfs.TestRollingUpgrade   org.apache.hadoop.hdfs.TestRollingUpgradeRollback   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.TestClientReportBadBlock JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestReadStripedFileWithDecoding   hadoop.hdfs.TestFileStatus   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.fs.contract.hdfs.TestHDFSContractOpen   hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.TestEncryptionZonesWithHA   hadoop.fs.contract.hdfs.TestHDFSContractMkdir   hadoop.hdfs.TestDFSShell   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.qjournal.TestMiniJournalCluster   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.TestDecommission   hadoop.hdfs.TestDatanodeDeath   hadoop.hdfs.server.namenode.TestFSEditLogLoader   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.server.datanode.TestCachingStrategy   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.cli.TestXAttrCLI   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.server.namenode.TestParallelImageWrite   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional   hadoop.hdfs.server.namenode.TestSaveNamespace   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks   hadoop.hdfs.TestDFSRename   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   hadoop.hdfs.TestFileCreationEmpty   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods   hadoop.hdfs.TestRemoteBlockReader2   hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.server.namenode.TestFileLimit   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.TestEncryptionZones   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes   hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots   hadoop.hdfs.qjournal.TestNNWithQJM   hadoop.hdfs.tools.TestDelegationTokenFetcher   hadoop.hdfs.web.TestWebHdfsFileSystemContract   hadoop.hdfs.TestDFSFinalize   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.server.namenode.TestFileContextAcl   hadoop.hdfs.TestDatanodeRegistration   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.TestDataTransferProtocol   hadoop.fs.viewfs.TestViewFsWithXAttrs   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000   hadoop.hdfs.server.datanode.TestDiskError   hadoop.hdfs.TestFsShellPermission   hadoop.hdfs.server.namenode.TestMalformedURLs   hadoop.hdfs.TestBalancerBandwidth   hadoop.hdfs.TestReadWhileWriting   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100   hadoop.hdfs.qjournal.server.TestJournalNode   hadoop.fs.TestSWebHdfsFileContextMainOperations   hadoop.hdfs.TestWriteReadStripedFile   hadoop.hdfs.TestDisableConnCache   hadoop.hdfs.TestIsMethodSupported   hadoop.hdfs.TestDFSClientExcludedNodes   hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy   hadoop.hdfs.TestFileCreationClient   hadoop.hdfs.server.namenode.TestNameNodeReconfigure   hadoop.cli.TestAclCLI   hadoop.hdfs.TestFSOutputSummer   hadoop.hdfs.TestErasureCodingPolicies   hadoop.fs.TestHDFSFileContextMainOperations   hadoop.hdfs.TestDFSStartupVersions   hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.TestParallelShortCircuitLegacyRead   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure   hadoop.hdfs.server.namenode.TestGenericJournalConf   hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.web.TestWebHdfsTimeouts   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   hadoop.hdfs.TestParallelUnixDomainRead   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.fs.contract.hdfs.TestHDFSContractSeek   hadoop.hdfs.TestLocalDFS   hadoop.hdfs.server.mover.TestStorageMover   hadoop.hdfs.TestFileChecksum   hadoop.hdfs.TestGetFileChecksum   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.hdfs.server.namenode.TestMetadataVersionOutput   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.fs.TestUnbuffer   hadoop.hdfs.TestDFSPermission   hadoop.hdfs.TestParallelRead   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.server.namenode.TestAddBlock   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   hadoop.hdfs.server.namenode.TestMetaSave   hadoop.hdfs.TestSmallBlock   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.web.TestHttpsFileSystem   hadoop.tracing.TestTracing   hadoop.hdfs.TestListFilesInDFS   hadoop.cli.TestErasureCodingCLI   hadoop.hdfs.TestFileAppendRestart   hadoop.hdfs.TestBlockReaderLocal   hadoop.hdfs.TestDFSStripedInputStream   hadoop.hdfs.server.datanode.TestTriggerBlockReport   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.fs.contract.hdfs.TestHDFSContractConcat   hadoop.hdfs.TestReplication   hadoop.hdfs.server.namenode.TestEditLog   hadoop.security.TestRefreshUserMappings   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.hdfs.server.mover.TestMover   hadoop.hdfs.TestSafeMode   hadoop.hdfs.tools.TestDFSZKFailoverController   hadoop.hdfs.server.namenode.TestHDFSConcat   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs   hadoop.hdfs.server.datanode.TestDataNodeLifeline   hadoop.security.TestPermissionSymlinks   hadoop.hdfs.TestHFlush   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.fs.TestSymlinkHdfsDisable   hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.TestFileCreation   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.qjournal.TestSecureNNWithQJM   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   hadoop.hdfs.TestRollingUpgradeDowngrade   hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   hadoop.hdfs.TestBlockReaderFactory   hadoop.hdfs.TestRemoteBlockReader   hadoop.hdfs.TestFetchImage   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010   hadoop.hdfs.server.namenode.TestReconstructStripedBlocks   hadoop.hdfs.TestDFSOutputStream   hadoop.fs.TestUrlStreamHandler   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200   hadoop.hdfs.server.datanode.TestBatchIbr   hadoop.hdfs.TestModTime   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs   hadoop.hdfs.TestFileStatusWithECPolicy   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.tools.TestGetGroups   hadoop.hdfs.server.namenode.TestNameNodeRecovery   hadoop.hdfs.TestRestartDFS   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   hadoop.hdfs.TestInjectionForSimulatedStorage   hadoop.hdfs.TestDFSStripedOutputStream   hadoop.hdfs.TestMiniDFSCluster   hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.TestLease   hadoop.hdfs.server.namenode.TestProtectedDirectories   hadoop.hdfs.TestHdfsAdmin   hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot   hadoop.hdfs.server.balancer.TestBalancer   hadoop.hdfs.server.namenode.TestAuditLogs   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.fs.TestWebHdfsFileContextMainOperations   hadoop.hdfs.server.namenode.ha.TestNNHealthCheck   hadoop.hdfs.TestDFSAddressConfig   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.tools.TestJMXGet   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.TestDFSMkdirs   hadoop.hdfs.TestWriteRead   hadoop.hdfs.TestClientBlockVerification   hadoop.fs.viewfs.TestViewFsDefaultValue   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   hadoop.hdfs.TestDatanodeConfig   hadoop.hdfs.TestDecommissionWithStriped   hadoop.hdfs.server.namenode.TestNameNodeResourceChecker   hadoop.hdfs.server.namenode.TestAddStripedBlocks   hadoop.hdfs.server.datanode.TestDataNodeECN   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.hdfs.qjournal.client.TestQuorumJournalManager   hadoop.hdfs.server.datanode.TestDataNodeMXBean   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.server.namenode.TestBackupNode   hadoop.cli.TestHDFSCLI   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.server.namenode.TestAllowFormat   hadoop.hdfs.server.namenode.TestValidateConfigurationSettings   hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   hadoop.hdfs.server.namenode.TestNameNodeRpcServer   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   hadoop.fs.contract.hdfs.TestHDFSContractDelete   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.server.namenode.TestCheckpoint   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.hdfs.server.namenode.TestDeadDatanode   hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter   hadoop.hdfs.TestDatanodeReport   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.TestClientReportBadBlock   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA   hadoop.hdfs.server.namenode.TestNNThroughputBenchmark   hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy   hadoop.hdfs.TestDFSShellGenericOptions   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain   hadoop.security.TestPermission   hadoop.hdfs.web.TestWebHDFSAcl   hadoop.hdfs.TestMissingBlocksAlert   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.hdfs.TestClose   hadoop.cli.TestDeleteCLI   hadoop.hdfs.tools.TestDebugAdmin   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.fs.TestFcHdfsCreateMkdir   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.TestErasureCodingPolicyWithSnapshot   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.namenode.TestXAttrConfigFlag   hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy   hadoop.fs.permission.TestStickyBit   hadoop.hdfs.tools.TestDFSAdminWithHA   hadoop.fs.viewfs.TestViewFsWithAcls   hadoop.hdfs.tools.TestStoragePolicyCommands   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   hadoop.hdfs.server.namenode.TestNestedEncryptionZones   hadoop.hdfs.server.namenode.TestStartup   hadoop.hdfs.TestMultiThreadedHflush   hadoop.TestGenericRefresh   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   hadoop.hdfs.TestQuota   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   hadoop.hdfs.TestConnCache   hadoop.fs.viewfs.TestViewFsAtHdfsRoot   hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.TestCrcCorruption   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.tracing.TestTracingShortCircuitLocalRead   hadoop.fs.TestFcHdfsPermission   hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   hadoop.hdfs.TestLeaseRecovery   hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics   hadoop.hdfs.TestFileLengthOnClusterRestart   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory   hadoop.fs.contract.hdfs.TestHDFSContractCreate   hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN   hadoop.hdfs.TestFileAppend   hadoop.hdfs.web.TestWebHDFS   hadoop.hdfs.TestGetBlocks   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.qjournal.server.TestJournalNodeMXBean   hadoop.hdfs.server.namenode.TestNameNodeHttpServer   hadoop.fs.TestResolveHdfsSymlink   hadoop.hdfs.server.datanode.TestStorageReport   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl   hadoop.hdfs.TestDFSUpgrade   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.TestPread   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.tracing.TestTraceAdmin   hadoop.hdfs.qjournal.client.TestEpochsAreUnique   hadoop.hdfs.qjournal.client.TestQJMWithFaults   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.hdfs.server.namenode.TestNameEditsConfigs   hadoop.cli.TestCacheAdminCLI   hadoop.hdfs.server.datanode.TestDataNodeExit   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.server.datanode.TestRefreshNamenodes   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   hadoop.hdfs.web.TestWebHDFSForHA   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   hadoop.hdfs.server.namenode.TestHostsFiles   hadoop.hdfs.TestApplyingStoragePolicy   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength   hadoop.hdfs.web.TestFSMainOperationsWebHdfs   hadoop.hdfs.server.namenode.TestEditLogRace   hadoop.hdfs.TestReservedRawPaths   hadoop.TestRefreshCallQueue   hadoop.hdfs.TestSetTimes   hadoop.hdfs.TestDFSUpgradeFromImage   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   hadoop.hdfs.TestDFSClientSocketSize   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.fs.TestEnhancedByteBufferAccess   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.TestClientProtocolForPipelineRecovery   hadoop.hdfs.TestDFSStorageStateRecovery   hadoop.hdfs.TestPersistBlocks   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.TestListFilesInFileContext   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   hadoop.hdfs.TestBlockMissingException   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.fs.viewfs.TestViewFileSystemHdfs   hadoop.hdfs.server.datanode.TestBlockRecovery   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.tools.TestDFSHAAdminMiniCluster   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.server.namenode.TestBlockUnderConstruction   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.TestDFSClientRetries   hadoop.hdfs.server.namenode.TestINodeAttributeProvider   hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens   hadoop.hdfs.TestParallelShortCircuitReadUnCached   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020   hadoop.hdfs.tools.TestDFSAdmin   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.crypto.TestHdfsCryptoStreams   hadoop.hdfs.TestRead   hadoop.hdfs.TestDFSInotifyEventInputStream   hadoop.hdfs.server.datanode.TestDataNodeInitStorage   hadoop.hdfs.server.namenode.TestFSNamesystemMBean   hadoop.fs.loadGenerator.TestLoadGenerator   hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId   hadoop.fs.contract.hdfs.TestHDFSContractAppend   hadoop.hdfs.server.namenode.TestSecondaryWebUi   hadoop.fs.viewfs.TestViewFileSystemWithAcls   hadoop.hdfs.web.TestWebHDFSXAttr   hadoop.hdfs.server.datanode.TestIncrementalBlockReports   hadoop.hdfs.web.TestWebHdfsTokens   hadoop.hdfs.TestSetrepIncreasing   hadoop.fs.TestFcHdfsSetUMask   hadoop.hdfs.TestLargeBlock   hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler   hadoop.hdfs.TestFileAppend3   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks   hadoop.hdfs.TestDFSClientFailover   hadoop.hdfs.server.namenode.TestStripedINodeFile   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   hadoop.hdfs.security.TestClientProtocolWithDelegationToken   hadoop.hdfs.server.namenode.ha.TestHAMetrics   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.hdfs.server.namenode.TestFSImage   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   hadoop.hdfs.server.namenode.TestAddBlockRetry   hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs   hadoop.hdfs.TestSafeModeWithStripedFile   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.TestPipelines   hadoop.hdfs.TestSetrepDecreasing   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.hdfs.server.namenode.TestTransferFsImage   hadoop.hdfs.server.namenode.ha.TestHAFsck   hadoop.hdfs.TestSeekBug   hadoop.hdfs.TestFileAppend4   hadoop.hdfs.TestDFSRemove   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.TestBlockReaderLocalLegacy   hadoop.hdfs.TestBlocksScheduledCounter   hadoop.hdfs.TestExternalBlockReader   hadoop.fs.viewfs.TestViewFsFileStatusHdfs   hadoop.hdfs.TestAclsEndToEnd   hadoop.hdfs.TestSnapshotCommands   hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize   hadoop.fs.shell.TestHdfsTextCommand   hadoop.hdfs.TestWriteConfigurationToDFS   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030   hadoop.hdfs.server.datanode.TestLargeBlockReport   hadoop.hdfs.TestDFSRollback   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot   hadoop.hdfs.TestFSInputChecker   hadoop.hdfs.TestParallelShortCircuitRead   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.hdfs.TestAbandonBlock   hadoop.fs.TestGlobPaths   hadoop.hdfs.TestDataTransferKeepalive   hadoop.hdfs.TestHDFSTrash   hadoop.hdfs.server.namenode.TestNameNodeAcl   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   hadoop.fs.contract.hdfs.TestHDFSContractRename   hadoop.hdfs.TestDFSInputStream   hadoop.hdfs.TestHDFSServerPorts   hadoop.hdfs.TestRenameWhileOpen   hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   hadoop.hdfs.server.datanode.TestDataNodeReconfiguration   hadoop.hdfs.TestEncryptedTransfer   hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger   hadoop.hdfs.TestHDFSFileSystemContract   hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.net.TestNetworkTopology   hadoop.hdfs.security.token.block.TestBlockToken   hadoop.hdfs.server.datanode.TestIncrementalBrVariations   hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness   hadoop.hdfs.server.datanode.TestHSync   hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   hadoop.hdfs.TestDatanodeLayoutUpgrade   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.TestCreateEditsLog   hadoop.hdfs.server.namenode.TestFileContextXAttr JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   org.apache.hadoop.hdfs.TestRollingUpgrade   org.apache.hadoop.hdfs.TestRollingUpgradeRollback   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799971/HDFS-9958.003.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 1af5b41854dc 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / a749ba0 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15244/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15244/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15244/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          kshukla Kuhu Shukla added a comment -

          Updating patch to address the case where we try and mark a block corrupt on a node's storage that is not known to the NN. This patch attempts to harden the addition to the corruptReplicasMap iff it has a valid entry in the triplets. Appreciate any comments/corrections.

          Show
          kshukla Kuhu Shukla added a comment - Updating patch to address the case where we try and mark a block corrupt on a node's storage that is not known to the NN. This patch attempts to harden the addition to the corruptReplicasMap iff it has a valid entry in the triplets. Appreciate any comments/corrections.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 20s Docker mode activated.
          +1 @author 0m 1s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 7m 40s trunk passed
          +1 compile 0m 54s trunk passed with JDK v1.8.0_77
          +1 compile 0m 50s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 1m 0s trunk passed
          +1 mvneclipse 0m 14s trunk passed
          +1 findbugs 2m 5s trunk passed
          +1 javadoc 1m 18s trunk passed with JDK v1.8.0_77
          +1 javadoc 2m 0s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 56s the patch passed
          +1 compile 0m 52s the patch passed with JDK v1.8.0_77
          +1 javac 0m 52s the patch passed
          +1 compile 0m 49s the patch passed with JDK v1.7.0_95
          +1 javac 0m 49s the patch passed
          -1 checkstyle 0m 22s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130)
          +1 mvnsite 0m 56s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 18s the patch passed
          +1 javadoc 1m 17s the patch passed with JDK v1.8.0_77
          +1 javadoc 2m 0s the patch passed with JDK v1.7.0_95
          -1 unit 102m 30s hadoop-hdfs in the patch failed with JDK v1.8.0_77.
          -1 unit 0m 16s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          132m 9s



          Reason Tests
          JDK v1.8.0_77 Failed junit tests hadoop.fs.contract.hdfs.TestHDFSContractMkdir
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.cli.TestDeleteCLI
            hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
            hadoop.cli.TestHDFSCLI
            hadoop.fs.contract.hdfs.TestHDFSContractRename
            hadoop.cli.TestCacheAdminCLI
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.fs.loadGenerator.TestLoadGenerator
            hadoop.fs.TestFcHdfsSetUMask
            hadoop.fs.viewfs.TestViewFsFileStatusHdfs
            hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            hadoop.tracing.TestTracingShortCircuitLocalRead
            hadoop.tracing.TestTracing
            hadoop.fs.TestWebHdfsFileContextMainOperations
            hadoop.net.TestNetworkTopology
            hadoop.fs.TestFcHdfsCreateMkdir
            hadoop.fs.TestFcHdfsPermission
            hadoop.hdfs.TestQuota
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.fs.viewfs.TestViewFsWithXAttrs
            hadoop.cli.TestErasureCodingCLI
            hadoop.tools.TestJMXGet
            hadoop.TestGenericRefresh
            hadoop.hdfs.TestDataTransferKeepalive
            hadoop.hdfs.TestErasureCodeBenchmarkThroughput
            hadoop.fs.TestSWebHdfsFileContextMainOperations
            hadoop.fs.contract.hdfs.TestHDFSContractDelete
            hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.TestReadStripedFileWithDecoding
            hadoop.TestRefreshCallQueue
            hadoop.cli.TestXAttrCLI
            hadoop.fs.TestUrlStreamHandler
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.fs.TestEnhancedByteBufferAccess
            hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
            hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
            hadoop.fs.TestHDFSFileContextMainOperations
            hadoop.hdfs.TestExternalBlockReader
            hadoop.fs.contract.hdfs.TestHDFSContractAppend
            hadoop.hdfs.TestReconstructStripedFile
            hadoop.hdfs.TestHdfsAdmin
            hadoop.fs.contract.hdfs.TestHDFSContractOpen
            hadoop.hdfs.TestFileCreation
            hadoop.tracing.TestTraceAdmin
            hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            hadoop.hdfs.TestAbandonBlock
            hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
            hadoop.fs.viewfs.TestViewFsHdfs
            hadoop.hdfs.TestDFSClientSocketSize
            hadoop.fs.contract.hdfs.TestHDFSContractConcat
            hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
            hadoop.cli.TestCryptoAdminCLI
            hadoop.hdfs.TestFileCreationDelete
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.cli.TestAclCLI
            hadoop.fs.viewfs.TestViewFileSystemWithAcls
            hadoop.fs.TestSymlinkHdfsFileContext
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130
            hadoop.fs.TestSymlinkHdfsFileSystem
            hadoop.fs.TestUnbuffer
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070
            hadoop.fs.viewfs.TestViewFsWithAcls
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.TestEncryptionZones
            hadoop.fs.TestResolveHdfsSymlink
            hadoop.fs.viewfs.TestViewFsDefaultValue
            hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
            hadoop.fs.viewfs.TestViewFileSystemHdfs
            hadoop.hdfs.TestDFSRemove
            hadoop.fs.viewfs.TestViewFsAtHdfsRoot
            hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
            hadoop.hdfs.TestFileCreationClient
            hadoop.fs.contract.hdfs.TestHDFSContractCreate
            hadoop.fs.permission.TestStickyBit
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.fs.TestSymlinkHdfsDisable
            hadoop.hdfs.TestLease
            hadoop.fs.TestGlobPaths
            hadoop.fs.contract.hdfs.TestHDFSContractSeek
            hadoop.fs.shell.TestHdfsTextCommand
          JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.TestReplication
            org.apache.hadoop.hdfs.server.namenode.TestFsck
            org.apache.hadoop.hdfs.TestMissingBlocksAlert
            org.apache.hadoop.hdfs.TestClientReportBadBlock



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800242/HDFS-9958.004.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 24ca437c8d52 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 5d4255a
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15255/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15255/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated. +1 @author 0m 1s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 40s trunk passed +1 compile 0m 54s trunk passed with JDK v1.8.0_77 +1 compile 0m 50s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 23s trunk passed +1 mvnsite 1m 0s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 2m 5s trunk passed +1 javadoc 1m 18s trunk passed with JDK v1.8.0_77 +1 javadoc 2m 0s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 56s the patch passed +1 compile 0m 52s the patch passed with JDK v1.8.0_77 +1 javac 0m 52s the patch passed +1 compile 0m 49s the patch passed with JDK v1.7.0_95 +1 javac 0m 49s the patch passed -1 checkstyle 0m 22s hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 130 unchanged - 0 fixed = 132 total (was 130) +1 mvnsite 0m 56s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 18s the patch passed +1 javadoc 1m 17s the patch passed with JDK v1.8.0_77 +1 javadoc 2m 0s the patch passed with JDK v1.7.0_95 -1 unit 102m 30s hadoop-hdfs in the patch failed with JDK v1.8.0_77. -1 unit 0m 16s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 132m 9s Reason Tests JDK v1.8.0_77 Failed junit tests hadoop.fs.contract.hdfs.TestHDFSContractMkdir   hadoop.hdfs.TestBlockStoragePolicy   hadoop.cli.TestDeleteCLI   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory   hadoop.cli.TestHDFSCLI   hadoop.fs.contract.hdfs.TestHDFSContractRename   hadoop.cli.TestCacheAdminCLI   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.fs.loadGenerator.TestLoadGenerator   hadoop.fs.TestFcHdfsSetUMask   hadoop.fs.viewfs.TestViewFsFileStatusHdfs   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.tracing.TestTracingShortCircuitLocalRead   hadoop.tracing.TestTracing   hadoop.fs.TestWebHdfsFileContextMainOperations   hadoop.net.TestNetworkTopology   hadoop.fs.TestFcHdfsCreateMkdir   hadoop.fs.TestFcHdfsPermission   hadoop.hdfs.TestQuota   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.fs.viewfs.TestViewFsWithXAttrs   hadoop.cli.TestErasureCodingCLI   hadoop.tools.TestJMXGet   hadoop.TestGenericRefresh   hadoop.hdfs.TestDataTransferKeepalive   hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.fs.TestSWebHdfsFileContextMainOperations   hadoop.fs.contract.hdfs.TestHDFSContractDelete   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.TestFileAppend   hadoop.hdfs.TestReadStripedFileWithDecoding   hadoop.TestRefreshCallQueue   hadoop.cli.TestXAttrCLI   hadoop.fs.TestUrlStreamHandler   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.fs.TestEnhancedByteBufferAccess   hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs   hadoop.fs.TestHDFSFileContextMainOperations   hadoop.hdfs.TestExternalBlockReader   hadoop.fs.contract.hdfs.TestHDFSContractAppend   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.TestHdfsAdmin   hadoop.fs.contract.hdfs.TestHDFSContractOpen   hadoop.hdfs.TestFileCreation   hadoop.tracing.TestTraceAdmin   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.TestAbandonBlock   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.hdfs.TestDFSClientSocketSize   hadoop.fs.contract.hdfs.TestHDFSContractConcat   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.cli.TestAclCLI   hadoop.fs.viewfs.TestViewFileSystemWithAcls   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.fs.TestUnbuffer   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070   hadoop.fs.viewfs.TestViewFsWithAcls   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.TestEncryptionZones   hadoop.fs.TestResolveHdfsSymlink   hadoop.fs.viewfs.TestViewFsDefaultValue   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus   hadoop.fs.viewfs.TestViewFileSystemHdfs   hadoop.hdfs.TestDFSRemove   hadoop.fs.viewfs.TestViewFsAtHdfsRoot   hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks   hadoop.hdfs.TestFileCreationClient   hadoop.fs.contract.hdfs.TestHDFSContractCreate   hadoop.fs.permission.TestStickyBit   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.fs.TestSymlinkHdfsDisable   hadoop.hdfs.TestLease   hadoop.fs.TestGlobPaths   hadoop.fs.contract.hdfs.TestHDFSContractSeek   hadoop.fs.shell.TestHdfsTextCommand JDK v1.8.0_77 Timed out junit tests org.apache.hadoop.hdfs.TestReplication   org.apache.hadoop.hdfs.server.namenode.TestFsck   org.apache.hadoop.hdfs.TestMissingBlocksAlert   org.apache.hadoop.hdfs.TestClientReportBadBlock Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800242/HDFS-9958.004.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 24ca437c8d52 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5d4255a Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_77 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15255/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_77.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15255/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15255/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          kshukla Kuhu Shukla added a comment -

          This patch addresses the issue introduced in the previous patch of null storageID which lead to a couple of tests failures. This is fixed through doing a lookup if the storage is null and finding the appropriate storage if present.

          Show
          kshukla Kuhu Shukla added a comment - This patch addresses the issue introduced in the previous patch of null storageID which lead to a couple of tests failures. This is fixed through doing a lookup if the storage is null and finding the appropriate storage if present.
          Hide
          kshukla Kuhu Shukla added a comment -

          Requesting Walter Su, Daryn Sharp, Kihwal Lee for review/comments. Thanks a lot!

          Show
          kshukla Kuhu Shukla added a comment - Requesting Walter Su , Daryn Sharp , Kihwal Lee for review/comments. Thanks a lot!
          Hide
          walter.k.su Walter Su added a comment -
          @@ -1320,11 +1320,22 @@ public void findAndMarkBlockAsCorrupt(final ExtendedBlock blk,
                ....
          +    if (storage == null) {
          +      storage = storedBlock.findStorageInfo(node);
          +    }
          

          I'm surprised that most of the time, storageID is null. It makes the code above error prone, because the blk can be added/moved to another healthy storage in the same node. I suppose we should add the storageID message into the request.

          +1. re-trigger the jenkins.

          Show
          walter.k.su Walter Su added a comment - @@ -1320,11 +1320,22 @@ public void findAndMarkBlockAsCorrupt( final ExtendedBlock blk, .... + if (storage == null ) { + storage = storedBlock.findStorageInfo(node); + } I'm surprised that most of the time, storageID is null. It makes the code above error prone, because the blk can be added/moved to another healthy storage in the same node. I suppose we should add the storageID message into the request. +1. re-trigger the jenkins.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 23s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 11m 35s trunk passed
          +1 compile 1m 55s trunk passed with JDK v1.8.0_92
          +1 compile 1m 19s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 36s trunk passed
          +1 mvnsite 1m 18s trunk passed
          +1 mvneclipse 0m 16s trunk passed
          +1 findbugs 2m 13s trunk passed
          +1 javadoc 1m 17s trunk passed with JDK v1.8.0_92
          +1 javadoc 1m 58s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 54s the patch passed
          +1 compile 0m 55s the patch passed with JDK v1.8.0_92
          +1 javac 0m 55s the patch passed
          +1 compile 0m 46s the patch passed with JDK v1.7.0_95
          +1 javac 0m 46s the patch passed
          +1 checkstyle 0m 21s the patch passed
          +1 mvnsite 0m 56s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 16s the patch passed
          +1 javadoc 1m 25s the patch passed with JDK v1.8.0_92
          +1 javadoc 2m 3s the patch passed with JDK v1.7.0_95
          -1 unit 96m 45s hadoop-hdfs in the patch failed with JDK v1.8.0_92.
          -1 unit 82m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          214m 27s



          Reason Tests
          JDK v1.8.0_92 Failed junit tests hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.datanode.TestDataNodeLifeline
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.TestErasureCodeBenchmarkThroughput
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
            hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800521/HDFS-9958.005.patch
          JIRA Issue HDFS-9958
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 3f780bb544d7 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 68b4564
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_92 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_92.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_92.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15304/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15304/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 11m 35s trunk passed +1 compile 1m 55s trunk passed with JDK v1.8.0_92 +1 compile 1m 19s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 36s trunk passed +1 mvnsite 1m 18s trunk passed +1 mvneclipse 0m 16s trunk passed +1 findbugs 2m 13s trunk passed +1 javadoc 1m 17s trunk passed with JDK v1.8.0_92 +1 javadoc 1m 58s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 54s the patch passed +1 compile 0m 55s the patch passed with JDK v1.8.0_92 +1 javac 0m 55s the patch passed +1 compile 0m 46s the patch passed with JDK v1.7.0_95 +1 javac 0m 46s the patch passed +1 checkstyle 0m 21s the patch passed +1 mvnsite 0m 56s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 16s the patch passed +1 javadoc 1m 25s the patch passed with JDK v1.8.0_92 +1 javadoc 2m 3s the patch passed with JDK v1.7.0_95 -1 unit 96m 45s hadoop-hdfs in the patch failed with JDK v1.8.0_92. -1 unit 82m 6s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 214m 27s Reason Tests JDK v1.8.0_92 Failed junit tests hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.datanode.TestDataNodeLifeline   hadoop.hdfs.TestFileAppend   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure JDK v1.7.0_95 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs   hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800521/HDFS-9958.005.patch JIRA Issue HDFS-9958 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 3f780bb544d7 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 68b4564 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_92 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_92.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_92.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15304/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15304/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15304/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          walter.k.su Walter Su added a comment -

          Failed tests are not related. Will commit shortly if there's no further comment.

          Show
          walter.k.su Walter Su added a comment - Failed tests are not related. Will commit shortly if there's no further comment.
          Hide
          daryn Daryn Sharp added a comment - - edited

          I was on and off helping Kuhu with the patch. I'll take a quick pass over it today.

          Show
          daryn Daryn Sharp added a comment - - edited I was on and off helping Kuhu with the patch. I'll take a quick pass over it today.
          Hide
          kihwal Kihwal Lee added a comment -

          I'm surprised that most of the time, storageID is null.

          The storageID is not always available. If a corruption is detected by the block/volume scanner, storageID can be filled in. But when bad blocks are reported by reportRemoteBadBlock() during re-replication or balancing, the reporting node won't know the ID. If we blindly make it report the locally available id, it will end up reporting a wrong id. I think only DFSClient currently reports storageID. This shouldn't be a problem as long as the assumption that a datanode stores only one replica/stripe of a block holds.

          Show
          kihwal Kihwal Lee added a comment - I'm surprised that most of the time, storageID is null. The storageID is not always available. If a corruption is detected by the block/volume scanner, storageID can be filled in. But when bad blocks are reported by reportRemoteBadBlock() during re-replication or balancing, the reporting node won't know the ID. If we blindly make it report the locally available id, it will end up reporting a wrong id. I think only DFSClient currently reports storageID . This shouldn't be a problem as long as the assumption that a datanode stores only one replica/stripe of a block holds.
          Hide
          walter.k.su Walter Su added a comment -

          I think only DFSClient currently reports storageID.

          No, it doesn't.

          //DFSInputStream.java
            protected void reportCheckSumFailure(CorruptedBlocks corruptedBlocks,
                int dataNodeCount, boolean isStriped) {
          ...
                  reportList.add(new LocatedBlock(blk, locs));
                }
              }
          ...
           dfsClient.reportChecksumFailure(src,
                    reportList.toArray(new LocatedBlock[reportList.size()]));
          

          locs is DatanodeInfoWithStorage actually, it has the storageIDs. But the LocatedBlock constructor is wrong.

            public LocatedBlock(ExtendedBlock b, DatanodeInfo[] locs) {
              // By default, startOffset is unknown(-1) and corrupt is false.
              this(b, locs, null, null, -1, false, EMPTY_LOCS);
            }
          ...
          ...
            public LocatedBlock(ExtendedBlock b, DatanodeInfo[] locs, String[] storageIDs,
                StorageType[] storageTypes, long startOffset,
                boolean corrupt, DatanodeInfo[] cachedLocs) {
          ...
          DatanodeInfoWithStorage storage = new DatanodeInfoWithStorage(di,
                      storageIDs != null ? storageIDs[i] : null,
                      storageTypes != null ? storageTypes[i] : null);
                  this.locs[i] = storage;
          

          It loses the storageIDs.

          Show
          walter.k.su Walter Su added a comment - I think only DFSClient currently reports storageID. No, it doesn't. //DFSInputStream.java protected void reportCheckSumFailure(CorruptedBlocks corruptedBlocks, int dataNodeCount, boolean isStriped) { ... reportList.add( new LocatedBlock(blk, locs)); } } ... dfsClient.reportChecksumFailure(src, reportList.toArray( new LocatedBlock[reportList.size()])); locs is DatanodeInfoWithStorage actually, it has the storageIDs. But the LocatedBlock constructor is wrong. public LocatedBlock(ExtendedBlock b, DatanodeInfo[] locs) { // By default , startOffset is unknown(-1) and corrupt is false . this (b, locs, null , null , -1, false , EMPTY_LOCS); } ... ... public LocatedBlock(ExtendedBlock b, DatanodeInfo[] locs, String [] storageIDs, StorageType[] storageTypes, long startOffset, boolean corrupt, DatanodeInfo[] cachedLocs) { ... DatanodeInfoWithStorage storage = new DatanodeInfoWithStorage(di, storageIDs != null ? storageIDs[i] : null , storageTypes != null ? storageTypes[i] : null ); this .locs[i] = storage; It loses the storageIDs.
          Hide
          daryn Daryn Sharp added a comment -

          +1 Looks goods. Will file a followup for other improvements.

          Regarding whether the client should pass the storage id or not, with the current design it definitely should not. The client requests a block from the datanode. The datanode serves from whatever storage it's on. Now let's say the client thinks the block is on S1, but it's really on S3. The storage cannot be honored. Only the DN should report the storage because it's authoritative.

          Show
          daryn Daryn Sharp added a comment - +1 Looks goods. Will file a followup for other improvements. Regarding whether the client should pass the storage id or not, with the current design it definitely should not. The client requests a block from the datanode. The datanode serves from whatever storage it's on. Now let's say the client thinks the block is on S1, but it's really on S3. The storage cannot be honored. Only the DN should report the storage because it's authoritative.
          Hide
          kihwal Kihwal Lee added a comment -

          Thanks for filing HDFS-10342 and HDFS-10343, Daryn.
          +1 from me too. I will commit it soon.

          Show
          kihwal Kihwal Lee added a comment - Thanks for filing HDFS-10342 and HDFS-10343 , Daryn. +1 from me too. I will commit it soon.
          Hide
          kihwal Kihwal Lee added a comment -

          Kuhu Shukla please post patches for other target branches.

          Show
          kihwal Kihwal Lee added a comment - Kuhu Shukla please post patches for other target branches.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #9688 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9688/)
          HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for (kihwal: rev 6243eabb48390fffada2418ade5adf9e0766afbe)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileCorruption.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9688 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9688/ ) HDFS-9958 . BlockManager#createLocatedBlocks can throw NPE for (kihwal: rev 6243eabb48390fffada2418ade5adf9e0766afbe) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileCorruption.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Hide
          brahmareddy Brahma Reddy Battula added a comment -

          I think, we can fix this simple way, where we include HDFS-10343 here only..

          -    final DatanodeStorageInfo[] machines = new DatanodeStorageInfo[numMachines];
          +    //final DatanodeStorageInfo[] machines = new DatanodeStorageInfo[numMachines];
          +    List<DatanodeStorageInfo> machinesList= new ArrayList<>(numMachines) ;
               final byte[] blockIndices = blk.isStriped() ? new byte[numMachines] : null;
               int j = 0, i = 0;
               if (numMachines > 0) {
          @@ -1048,7 +1049,9 @@ private LocatedBlock createLocatedBlock(final BlockInfo blk, final long pos)
                   final DatanodeDescriptor d = storage.getDatanodeDescriptor();
                   final boolean replicaCorrupt = corruptReplicas.isReplicaCorrupt(blk, d);
                   if (isCorrupt || (!replicaCorrupt)) {
          -          machines[j++] = storage;
          +          //machines[j++] = storage;
          +            j++;
          +            machinesList.add(storage);
                     // TODO this can be more efficient
                     if (blockIndices != null) {
                       byte index = ((BlockInfoStriped) blk).getStorageBlockIndex(storage);
          @@ -1058,6 +1061,7 @@ private LocatedBlock createLocatedBlock(final BlockInfo blk, final long pos)
                   }
                 }
               }
          +    final DatanodeStorageInfo[] machines=machinesList.toArray(new DatanodeStorageInfo[j]);
          

          correct me if I am wrong.. thanks..

          Show
          brahmareddy Brahma Reddy Battula added a comment - I think, we can fix this simple way, where we include HDFS-10343 here only.. - final DatanodeStorageInfo[] machines = new DatanodeStorageInfo[numMachines]; + // final DatanodeStorageInfo[] machines = new DatanodeStorageInfo[numMachines]; + List<DatanodeStorageInfo> machinesList= new ArrayList<>(numMachines) ; final byte [] blockIndices = blk.isStriped() ? new byte [numMachines] : null ; int j = 0, i = 0; if (numMachines > 0) { @@ -1048,7 +1049,9 @@ private LocatedBlock createLocatedBlock( final BlockInfo blk, final long pos) final DatanodeDescriptor d = storage.getDatanodeDescriptor(); final boolean replicaCorrupt = corruptReplicas.isReplicaCorrupt(blk, d); if (isCorrupt || (!replicaCorrupt)) { - machines[j++] = storage; + //machines[j++] = storage; + j++; + machinesList.add(storage); // TODO this can be more efficient if (blockIndices != null ) { byte index = ((BlockInfoStriped) blk).getStorageBlockIndex(storage); @@ -1058,6 +1061,7 @@ private LocatedBlock createLocatedBlock( final BlockInfo blk, final long pos) } } } + final DatanodeStorageInfo[] machines=machinesList.toArray( new DatanodeStorageInfo[j]); correct me if I am wrong.. thanks..
          Hide
          kshukla Kuhu Shukla added a comment -

          Brahma Reddy Battula I am apprehensive of using an ArrayList instead of the plain array since when I looked at an old thread for this code, it talked about how using lists will not be as fast. I can try and dig that out.

          Show
          kshukla Kuhu Shukla added a comment - Brahma Reddy Battula I am apprehensive of using an ArrayList instead of the plain array since when I looked at an old thread for this code, it talked about how using lists will not be as fast. I can try and dig that out.
          Hide
          kshukla Kuhu Shukla added a comment -

          Attaching branch-2 and branch-2.7 patches.

          branch-2 patch applies clean to branch-2.8.

          Kihwal Lee, Request for comments/review. Thanks a lot!

          Show
          kshukla Kuhu Shukla added a comment - Attaching branch-2 and branch-2.7 patches. branch-2 patch applies clean to branch-2.8. Kihwal Lee , Request for comments/review. Thanks a lot!
          Hide
          kihwal Kihwal Lee added a comment -

          +1 for the branch-2 version.

          Show
          kihwal Kihwal Lee added a comment - +1 for the branch-2 version.
          Hide
          kihwal Kihwal Lee added a comment -

          +1 branch-2.7 patch.

          Show
          kihwal Kihwal Lee added a comment - +1 branch-2.7 patch.
          Hide
          kihwal Kihwal Lee added a comment -

          Committed this to trunk through branch-2.7. Thanks for working on this, Kuhu Shukla and thanks for reviews and feedback, Walter Su.

          Show
          kihwal Kihwal Lee added a comment - Committed this to trunk through branch-2.7. Thanks for working on this, Kuhu Shukla and thanks for reviews and feedback, Walter Su .
          Hide
          kihwal Kihwal Lee added a comment -

          I found out missed branch-2.8. Just picked it to branch-2.8.

          Show
          kihwal Kihwal Lee added a comment - I found out missed branch-2.8. Just picked it to branch-2.8.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Closing the JIRA as part of 2.7.3 release.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Closing the JIRA as part of 2.7.3 release.

            People

            • Assignee:
              kshukla Kuhu Shukla
              Reporter:
              kshukla Kuhu Shukla
            • Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development