Details
-
Type:
Improvement
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 2.8.0, 2.7.4, 3.0.0-alpha1
-
Component/s: datanode
-
Labels:None
-
Target Version/s:
-
Hadoop Flags:Reviewed
Description
When a DN has received a block, it immediately sends a block receipt IBR RPC to NN for reporting the block. Even if a DN has received multiple blocks at the same time, it still sends multiple RPCs. It does not scale well since NN has to process a huge number of RPCs when many DNs receiving many blocks at the same time.
Issue Links
- incorporates
-
HDFS-9729
Use null to replace DataNode.EMPTY_DEL_HINT
-
- Resolved
-
- is related to
-
HDFS-10810
Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.
-
- Resolved
-
- relates to
-
HDFS-8999
Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.
-
- Resolved
-
-
HDFS-11837
Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches
-
- Resolved
-
-
HDFS-9726
Refactor IBR code to a new class
-
- Resolved
-
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
h9710_20160201.patch:
- sets the default time interval between two IBR RPCs to 1s.
- batches IBRs when the replica is no on transient storage; otherwise, sends immediately.
 -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 0s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 6 new or modified test files. |
| 0 | mvndep | 0m 13s | Maven dependency ordering for branch |
| +1 | mvninstall | 11m 16s | trunk passed |
| +1 | compile | 1m 44s | trunk passed with JDK v1.8.0_66 |
| +1 | compile | 1m 8s | trunk passed with JDK v1.7.0_91 |
| +1 | checkstyle | 0m 40s | trunk passed |
| +1 | mvnsite | 1m 25s | trunk passed |
| +1 | mvneclipse | 0m 19s | trunk passed |
| +1 | findbugs | 2m 40s | trunk passed |
| +1 | javadoc | 2m 6s | trunk passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 58s | trunk passed with JDK v1.7.0_91 |
| 0 | mvndep | 0m 12s | Maven dependency ordering for patch |
| +1 | mvninstall | 1m 15s | the patch passed |
| +1 | compile | 1m 33s | the patch passed with JDK v1.8.0_66 |
| +1 | javac | 1m 33s | the patch passed |
| +1 | compile | 1m 7s | the patch passed with JDK v1.7.0_91 |
| +1 | javac | 1m 7s | the patch passed |
| -1 | checkstyle | 0m 39s | hadoop-hdfs-project/hadoop-hdfs: patch generated 4 new + 845 unchanged - 6 fixed = 849 total (was 851) |
| +1 | mvnsite | 1m 18s | the patch passed |
| +1 | mvneclipse | 0m 15s | the patch passed |
| -1 | whitespace | 0m 0s | The patch has 4 line(s) that end in whitespace. Use git apply --whitespace=fix. |
| +1 | findbugs | 3m 23s | the patch passed |
| +1 | javadoc | 1m 59s | the patch passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 41s | the patch passed with JDK v1.7.0_91 |
| -1 | unit | 127m 58s | hadoop-hdfs in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 106m 25s | hadoop-hdfs in the patch failed with JDK v1.7.0_91. |
| +1 | asflicense | 0m 22s | Patch does not generate ASF License warnings. |
| 277m 23s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_66 Failed junit tests | hadoop.hdfs.TestReadStripedFileWithDecoding |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.server.namenode.TestParallelImageWrite | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.server.mover.TestMover | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.fs.TestSymlinkHdfsFileContext | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.balancer.TestBalancer | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.security.TestDelegationTokenForProxyUser | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.TestFileAppend3 | |
| hadoop.hdfs.server.namenode.TestStripedINodeFile | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| JDK v1.8.0_66 Timed out junit tests | org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
| org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | |
| JDK v1.7.0_91 Failed junit tests | hadoop.hdfs.TestReadStripedFileWithDecoding |
| hadoop.hdfs.TestDecommission | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks | |
| hadoop.hdfs.TestEncryptionZones | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.TestHFlush | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.security.TestDelegationTokenForProxyUser | |
| hadoop.hdfs.server.blockmanagement.TestPendingReplication | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.TestRecoverStripedFile | |
| hadoop.hdfs.server.datanode.TestDataNodeMetrics | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.server.namenode.ha.TestRequestHedgingProxyProvider | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | |
| hadoop.hdfs.server.namenode.TestFSImage | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| JDK v1.7.0_91 Timed out junit tests | org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
| org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics |
This message was automatically generated.
h9710_20160205.patch: sync'ed with trunk.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 10s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 5 new or modified test files. |
| 0 | mvndep | 0m 19s | Maven dependency ordering for branch |
| +1 | mvninstall | 6m 50s | trunk passed |
| +1 | compile | 0m 42s | trunk passed with JDK v1.8.0_66 |
| +1 | compile | 0m 40s | trunk passed with JDK v1.7.0_91 |
| +1 | checkstyle | 0m 32s | trunk passed |
| +1 | mvnsite | 0m 52s | trunk passed |
| +1 | mvneclipse | 0m 13s | trunk passed |
| +1 | findbugs | 1m 55s | trunk passed |
| +1 | javadoc | 1m 4s | trunk passed with JDK v1.8.0_66 |
| +1 | javadoc | 1m 47s | trunk passed with JDK v1.7.0_91 |
| 0 | mvndep | 0m 8s | Maven dependency ordering for patch |
| +1 | mvninstall | 0m 47s | the patch passed |
| +1 | compile | 0m 37s | the patch passed with JDK v1.8.0_66 |
| +1 | javac | 0m 37s | the patch passed |
| +1 | compile | 0m 39s | the patch passed with JDK v1.7.0_91 |
| +1 | javac | 0m 39s | the patch passed |
| -1 | checkstyle | 0m 30s | hadoop-hdfs-project/hadoop-hdfs: patch generated 3 new + 847 unchanged - 2 fixed = 850 total (was 849) |
| +1 | mvnsite | 0m 51s | the patch passed |
| +1 | mvneclipse | 0m 11s | the patch passed |
| -1 | whitespace | 0m 0s | The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. |
| +1 | findbugs | 2m 8s | the patch passed |
| +1 | javadoc | 1m 5s | the patch passed with JDK v1.8.0_66 |
| +1 | javadoc | 1m 44s | the patch passed with JDK v1.7.0_91 |
| -1 | unit | 97m 35s | hadoop-hdfs in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 94m 32s | hadoop-hdfs in the patch failed with JDK v1.7.0_91. |
| +1 | asflicense | 0m 21s | Patch does not generate ASF License warnings. |
| 218m 15s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_66 Failed junit tests | hadoop.fs.TestSymlinkHdfsFileContext |
| hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.TestDecommission | |
| hadoop.hdfs.server.balancer.TestBalancer | |
| hadoop.hdfs.server.namenode.TestCacheDirectives | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.TestReadStripedFileWithDecoding | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.TestReconstructStripedFile | |
| JDK v1.8.0_66 Timed out junit tests | org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
| org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | |
| JDK v1.7.0_91 Failed junit tests | hadoop.fs.viewfs.TestViewFsWithAcls |
| hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.TestDecommission | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.TestReadStripedFileWithDecoding | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| JDK v1.7.0_91 Timed out junit tests | org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
| org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics |
This message was automatically generated.
Many existing tests assume that datanodes send block receipt immediately. For example, TestDecommission#testRecommission creates a file with #replication == 5 and closes it. Then it calls getFileBlockLocations and expects the #locations must be 5. The assumption is incorrect since the test will fail if one of the 5 datanodes is slow. I will fix these tests later.
Let me test the patch with the new feature disabled.
h9710_20160216.patch: sets DFS_BLOCKREPORT_INCREMENTAL_INTERVAL_MSEC_DEFAULT to 0.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 16m 26s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 5 new or modified test files. |
| +1 | mvninstall | 6m 36s | trunk passed |
| +1 | compile | 0m 41s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 40s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 31s | trunk passed |
| +1 | mvnsite | 0m 52s | trunk passed |
| +1 | mvneclipse | 0m 13s | trunk passed |
| +1 | findbugs | 1m 56s | trunk passed |
| +1 | javadoc | 1m 10s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 56s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 49s | the patch passed |
| +1 | compile | 0m 44s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 44s | the patch passed |
| +1 | compile | 0m 39s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 39s | the patch passed |
| -1 | checkstyle | 0m 30s | hadoop-hdfs-project/hadoop-hdfs: patch generated 3 new + 903 unchanged - 2 fixed = 906 total (was 905) |
| +1 | mvnsite | 0m 49s | the patch passed |
| +1 | mvneclipse | 0m 11s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 2m 5s | the patch passed |
| +1 | javadoc | 1m 5s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 46s | the patch passed with JDK v1.7.0_95 |
| -1 | unit | 184m 48s | hadoop-hdfs in the patch failed with JDK v1.8.0_72. |
| -1 | unit | 186m 9s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| -1 | asflicense | 0m 24s | Patch generated 2 ASF License warnings. |
| 413m 7s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_72 Failed junit tests | hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210 | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.TestDFSRename | |
| hadoop.hdfs.server.namenode.TestQuotaByStorageType | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength | |
| hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints | |
| hadoop.hdfs.TestBlockReaderFactory | |
| hadoop.hdfs.TestDFSClientRetries | |
| hadoop.hdfs.TestFSOutputSummer | |
| hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol | |
| hadoop.hdfs.TestFileConcurrentReader | |
| hadoop.tools.TestJMXGet | |
| hadoop.hdfs.server.namenode.TestCheckpoint | |
| hadoop.hdfs.server.datanode.TestDiskError | |
| hadoop.hdfs.TestFileAppend2 | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.fs.TestUrlStreamHandler | |
| hadoop.hdfs.server.namenode.TestMetaSave | |
| hadoop.hdfs.TestDFSRemove | |
| hadoop.hdfs.TestLeaseRecovery | |
| hadoop.hdfs.TestClientProtocolForPipelineRecovery | |
| hadoop.fs.contract.hdfs.TestHDFSContractSeek | |
| hadoop.hdfs.server.datanode.TestHSync | |
| hadoop.fs.TestFcHdfsPermission | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.tools.TestStoragePolicyCommands | |
| hadoop.security.TestPermission | |
| hadoop.hdfs.TestReplication | |
| hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots | |
| hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork | |
| hadoop.hdfs.TestParallelShortCircuitReadUnCached | |
| hadoop.hdfs.TestPipelines | |
| hadoop.hdfs.TestReadStripedFileWithMissingBlocks | |
| hadoop.hdfs.TestParallelShortCircuitRead | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| hadoop.cli.TestAclCLI | |
| hadoop.hdfs.TestRenameWhileOpen | |
| hadoop.hdfs.server.blockmanagement.TestSequentialBlockId | |
| hadoop.hdfs.TestBlocksScheduledCounter | |
| hadoop.fs.contract.hdfs.TestHDFSContractDelete | |
| hadoop.hdfs.server.datanode.TestDataNodeMetrics | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 | |
| hadoop.hdfs.server.namenode.TestFSImageWithXAttr | |
| hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd | |
| hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer | |
| hadoop.fs.viewfs.TestViewFsFileStatusHdfs | |
| hadoop.hdfs.TestReconstructStripedFile | |
| hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer | |
| hadoop.hdfs.server.namenode.TestHostsFiles | |
| hadoop.hdfs.server.namenode.TestSnapshotPathINodes | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.server.namenode.ha.TestStandbyIsHot | |
| hadoop.hdfs.server.namenode.TestEditLog | |
| hadoop.hdfs.TestDataTransferKeepalive | |
| hadoop.hdfs.TestFSInputChecker | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes | |
| hadoop.hdfs.server.namenode.TestFileTruncate | |
| hadoop.hdfs.TestDFSUpgrade | |
| hadoop.hdfs.web.TestWebHdfsFileSystemContract | |
| hadoop.fs.permission.TestStickyBit | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS | |
| hadoop.hdfs.server.balancer.TestBalancer | |
| hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot | |
| hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.TestRead | |
| hadoop.fs.TestWebHdfsFileContextMainOperations | |
| hadoop.hdfs.server.namenode.ha.TestHAAppend | |
| hadoop.hdfs.TestDistributedFileSystem | |
| hadoop.hdfs.server.datanode.TestDeleteBlockPool | |
| hadoop.hdfs.TestHDFSTrash | |
| hadoop.hdfs.TestErasureCodeBenchmarkThroughput | |
| hadoop.hdfs.TestExternalBlockReader | |
| hadoop.hdfs.TestRemoteBlockReader | |
| hadoop.hdfs.web.TestHttpsFileSystem | |
| hadoop.fs.TestSWebHdfsFileContextMainOperations | |
| hadoop.fs.contract.hdfs.TestHDFSContractOpen | |
| hadoop.hdfs.TestCrcCorruption | |
| hadoop.fs.shell.TestHdfsTextCommand | |
| hadoop.hdfs.server.namenode.TestFileContextAcl | |
| hadoop.hdfs.TestSmallBlock | |
| hadoop.hdfs.TestDFSRollback | |
| hadoop.hdfs.server.namenode.ha.TestHAMetrics | |
| hadoop.hdfs.server.namenode.TestFsck | |
| hadoop.hdfs.server.blockmanagement.TestBlockManager | |
| hadoop.fs.contract.hdfs.TestHDFSContractCreate | |
| hadoop.hdfs.TestDFSStorageStateRecovery | |
| hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer | |
| hadoop.hdfs.server.namenode.TestFSImageWithSnapshot | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020 | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics | |
| hadoop.hdfs.TestAbandonBlock | |
| hadoop.hdfs.TestConnCache | |
| hadoop.hdfs.TestReadStripedFileWithDecoding | |
| hadoop.fs.TestFcHdfsSetUMask | |
| hadoop.hdfs.TestFileCorruption | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.namenode.TestFileLimit | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.TestFsShellPermission | |
| hadoop.hdfs.TestEncryptionZones | |
| hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting | |
| hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation | |
| hadoop.hdfs.TestParallelShortCircuitLegacyRead | |
| hadoop.hdfs.TestFileAppend4 | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks | |
| hadoop.hdfs.TestDFSFinalize | |
| hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages | |
| hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart | |
| hadoop.hdfs.TestLocalDFS | |
| hadoop.hdfs.server.datanode.TestCachingStrategy | |
| hadoop.hdfs.server.namenode.TestDeadDatanode | |
| hadoop.hdfs.server.datanode.TestReadOnlySharedStorage | |
| hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot | |
| hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock | |
| hadoop.fs.TestSymlinkHdfsDisable | |
| hadoop.hdfs.TestBlockMissingException | |
| hadoop.hdfs.TestFileAppend3 | |
| hadoop.hdfs.TestFileStatus | |
| hadoop.hdfs.TestQuota | |
| hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy | |
| hadoop.fs.TestSymlinkHdfsFileSystem | |
| hadoop.hdfs.TestListFilesInDFS | |
| hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs | |
| hadoop.hdfs.TestFileLengthOnClusterRestart | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| hadoop.hdfs.server.namenode.TestFSDirectory | |
| hadoop.hdfs.server.namenode.TestNameEditsConfigs | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters | |
| hadoop.hdfs.web.TestWebHDFSXAttr | |
| hadoop.hdfs.crypto.TestHdfsCryptoStreams | |
| hadoop.fs.contract.hdfs.TestHDFSContractConcat | |
| hadoop.hdfs.web.TestWebHDFSAcl | |
| hadoop.hdfs.TestDataTransferProtocol | |
| hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade | |
| hadoop.hdfs.TestRollingUpgrade | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.tools.TestDebugAdmin | |
| hadoop.hdfs.server.namenode.TestStartup | |
| hadoop.hdfs.TestDFSStripedOutputStream | |
| hadoop.hdfs.TestBalancerBandwidth | |
| hadoop.security.TestPermissionSymlinks | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing | |
| hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks | |
| hadoop.hdfs.TestInjectionForSimulatedStorage | |
| hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot | |
| hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer | |
| hadoop.fs.viewfs.TestViewFsHdfs | |
| hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | |
| hadoop.hdfs.server.namenode.ha.TestHAStateTransitions | |
| hadoop.hdfs.web.TestWebHDFS | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport | |
| hadoop.hdfs.TestDFSPermission | |
| hadoop.hdfs.TestFileCreation | |
| hadoop.fs.viewfs.TestViewFsAtHdfsRoot | |
| hadoop.fs.TestEnhancedByteBufferAccess | |
| hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting | |
| hadoop.hdfs.TestDFSInotifyEventInputStream | |
| hadoop.hdfs.server.datanode.TestIncrementalBrVariations | |
| hadoop.hdfs.server.namenode.TestAddBlockRetry | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 | |
| hadoop.fs.contract.hdfs.TestHDFSContractAppend | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.TestDFSClientExcludedNodes | |
| hadoop.fs.TestSymlinkHdfsFileContext | |
| hadoop.hdfs.TestErasureCodingPolicyWithSnapshot | |
| hadoop.hdfs.TestSafeModeWithStripedFile | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles | |
| hadoop.hdfs.server.namenode.TestProcessCorruptBlocks | |
| hadoop.hdfs.TestParallelRead | |
| hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots | |
| hadoop.hdfs.TestWriteRead | |
| hadoop.hdfs.TestPread | |
| hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.TestRestartDFS | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.tracing.TestTracing | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190 | |
| hadoop.hdfs.TestReservedRawPaths | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshot | |
| hadoop.hdfs.server.namenode.TestReconstructStripedBlocks | |
| hadoop.hdfs.server.datanode.TestFsDatasetCache | |
| hadoop.hdfs.TestEncryptionZonesWithHA | |
| hadoop.hdfs.server.datanode.TestIncrementalBlockReports | |
| hadoop.hdfs.TestDFSInputStream | |
| hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean | |
| hadoop.hdfs.TestDFSMkdirs | |
| hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks | |
| hadoop.hdfs.TestParallelShortCircuitReadNoChecksum | |
| hadoop.fs.TestFcHdfsCreateMkdir | |
| hadoop.hdfs.TestClientReportBadBlock | |
| hadoop.hdfs.server.namenode.ha.TestQuotasWithHA | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.TestHFlush | |
| hadoop.hdfs.TestParallelUnixDomainRead | |
| hadoop.hdfs.security.TestDelegationTokenForProxyUser | |
| hadoop.hdfs.server.namenode.TestLargeDirectoryDelete | |
| hadoop.fs.TestUnbuffer | |
| hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement | |
| hadoop.hdfs.TestFileAppendRestart | |
| hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes | |
| hadoop.hdfs.TestRemoteBlockReader2 | |
| hadoop.hdfs.TestSetrepIncreasing | |
| hadoop.hdfs.server.namenode.TestNestedEncryptionZones | |
| hadoop.hdfs.server.namenode.TestAuditLogs | |
| hadoop.hdfs.server.namenode.TestINodeFile | |
| hadoop.hdfs.security.TestDelegationToken | |
| hadoop.hdfs.server.namenode.TestParallelImageWrite | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation | |
| hadoop.hdfs.shortcircuit.TestShortCircuitCache | |
| hadoop.hdfs.TestReadWhileWriting | |
| hadoop.hdfs.TestDFSClientFailover | |
| hadoop.hdfs.server.namenode.TestCacheDirectives | |
| hadoop.fs.loadGenerator.TestLoadGenerator | |
| hadoop.hdfs.TestLease | |
| hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes | |
| hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes | |
| hadoop.hdfs.server.namenode.TestNameNodeAcl | |
| hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup | |
| hadoop.hdfs.TestModTime | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement | |
| hadoop.hdfs.server.namenode.TestNamenodeRetryCache | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot | |
| hadoop.hdfs.server.mover.TestMover | |
| hadoop.fs.contract.hdfs.TestHDFSContractRename | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration | |
| hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.datanode.TestBPOfferService | |
| hadoop.hdfs.TestWriteReadStripedFile | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 | |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| hadoop.hdfs.TestReplaceDatanodeOnFailure | |
| hadoop.hdfs.TestEncryptionZonesWithKMS | |
| hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA | |
| hadoop.hdfs.TestClientBlockVerification | |
| hadoop.hdfs.TestGetBlocks | |
| hadoop.hdfs.server.namenode.TestFileContextXAttr | |
| hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | |
| hadoop.hdfs.server.blockmanagement.TestPendingReplication | |
| hadoop.hdfs.TestSetrepDecreasing | |
| hadoop.hdfs.TestWriteBlockGetsBlockLengthHint | |
| hadoop.hdfs.TestMissingBlocksAlert | |
| hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN | |
| hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality | |
| hadoop.hdfs.security.token.block.TestBlockToken | |
| hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots | |
| hadoop.fs.contract.hdfs.TestHDFSContractMkdir | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.TestDFSShell | |
| hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| hadoop.hdfs.TestDecommission | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.TestBlockReaderLocal | |
| hadoop.hdfs.server.namenode.TestNameNodeXAttr | |
| hadoop.hdfs.server.namenode.TestStorageRestore | |
| hadoop.hdfs.TestHDFSFileSystemContract | |
| hadoop.hdfs.TestDFSStartupVersions | |
| hadoop.hdfs.server.blockmanagement.TestNodeCount | |
| hadoop.hdfs.TestAppendSnapshotTruncate | |
| hadoop.hdfs.server.namenode.TestFSImageWithAcl | |
| hadoop.fs.TestHDFSFileContextMainOperations | |
| hadoop.fs.viewfs.TestViewFsDefaultValue | |
| hadoop.hdfs.TestDatanodeDeath | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure | |
| hadoop.hdfs.TestAppendDifferentChecksum | |
| hadoop.hdfs.server.namenode.TestBackupNode | |
| hadoop.hdfs.TestSafeMode | |
| hadoop.hdfs.TestListFilesInFileContext | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.TestSeekBug | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl | |
| hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency | |
| hadoop.hdfs.server.namenode.TestStripedINodeFile | |
| hadoop.hdfs.TestDisableConnCache | |
| hadoop.hdfs.server.namenode.TestHDFSConcat | |
| hadoop.fs.viewfs.TestViewFileSystemHdfs | |
| hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId | |
| hadoop.hdfs.server.namenode.TestAddBlock | |
| hadoop.hdfs.TestLargeBlock | |
| hadoop.hdfs.TestBlockReaderLocalLegacy | |
| hadoop.hdfs.TestMultiThreadedHflush | |
| hadoop.tracing.TestTracingShortCircuitLocalRead | |
| hadoop.hdfs.web.TestFSMainOperationsWebHdfs | |
| hadoop.hdfs.TestClose | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap | |
| hadoop.hdfs.TestSetTimes | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130 | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter | |
| hadoop.hdfs.server.namenode.TestAddStripedBlocks | |
| hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks | |
| hadoop.hdfs.TestLeaseRecoveryStriped | |
| JDK v1.8.0_72 Timed out junit tests | org.apache.hadoop.hdfs.TestLeaseRecovery2 |
| org.apache.hadoop.hdfs.server.namenode.TestFSImage | |
| org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory | |
| org.apache.hadoop.hdfs.TestDatanodeReport | |
| org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean | |
| org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader | |
| org.apache.hadoop.hdfs.server.namenode.TestDeleteRace | |
| org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion | |
| org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction | |
| org.apache.hadoop.hdfs.TestPersistBlocks | |
| org.apache.hadoop.cli.TestHDFSCLI | |
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.TestDFSRename | |
| hadoop.hdfs.server.namenode.TestQuotaByStorageType | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength | |
| hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints | |
| hadoop.hdfs.TestBlockReaderFactory | |
| hadoop.hdfs.TestDFSClientRetries | |
| hadoop.hdfs.TestFSOutputSummer | |
| hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol | |
| hadoop.hdfs.TestFileConcurrentReader | |
| hadoop.tools.TestJMXGet | |
| hadoop.hdfs.server.namenode.TestCheckpoint | |
| hadoop.hdfs.server.datanode.TestDiskError | |
| hadoop.hdfs.TestFileAppend2 | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.fs.TestUrlStreamHandler | |
| hadoop.hdfs.server.namenode.TestMetaSave | |
| hadoop.hdfs.TestDFSRemove | |
| hadoop.hdfs.TestLeaseRecovery | |
| hadoop.hdfs.TestClientProtocolForPipelineRecovery | |
| hadoop.fs.contract.hdfs.TestHDFSContractSeek | |
| hadoop.hdfs.server.datanode.TestHSync | |
| hadoop.fs.TestFcHdfsPermission | |
| hadoop.hdfs.TestWriteConfigurationToDFS | |
| hadoop.hdfs.tools.TestStoragePolicyCommands | |
| hadoop.security.TestPermission | |
| hadoop.hdfs.TestReplication | |
| hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots | |
| hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork | |
| hadoop.hdfs.TestParallelShortCircuitReadUnCached | |
| hadoop.hdfs.TestPipelines | |
| hadoop.hdfs.TestReadStripedFileWithMissingBlocks | |
| hadoop.hdfs.TestParallelShortCircuitRead | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| hadoop.cli.TestAclCLI | |
| hadoop.hdfs.TestRenameWhileOpen | |
| hadoop.hdfs.server.blockmanagement.TestSequentialBlockId | |
| hadoop.hdfs.TestBlocksScheduledCounter | |
| hadoop.fs.contract.hdfs.TestHDFSContractDelete | |
| hadoop.hdfs.server.datanode.TestDataNodeMetrics | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename | |
| hadoop.hdfs.server.namenode.TestFSImageWithXAttr | |
| hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd | |
| hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer | |
| hadoop.fs.viewfs.TestViewFsFileStatusHdfs | |
| hadoop.hdfs.TestReconstructStripedFile | |
| hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer | |
| hadoop.hdfs.server.namenode.TestHostsFiles | |
| hadoop.hdfs.server.namenode.TestSnapshotPathINodes | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.server.namenode.ha.TestStandbyIsHot | |
| hadoop.hdfs.server.namenode.TestEditLog | |
| hadoop.hdfs.TestDataTransferKeepalive | |
| hadoop.hdfs.TestFSInputChecker | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200 | |
| hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes | |
| hadoop.hdfs.server.namenode.TestFileTruncate | |
| hadoop.hdfs.TestDFSUpgrade | |
| hadoop.hdfs.web.TestWebHdfsFileSystemContract | |
| hadoop.fs.permission.TestStickyBit | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS | |
| hadoop.hdfs.server.balancer.TestBalancer | |
| hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot | |
| hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.TestRead | |
| hadoop.fs.TestWebHdfsFileContextMainOperations | |
| hadoop.hdfs.server.namenode.ha.TestHAAppend | |
| hadoop.hdfs.TestDistributedFileSystem | |
| hadoop.hdfs.server.datanode.TestDeleteBlockPool | |
| hadoop.hdfs.TestHDFSTrash | |
| hadoop.hdfs.TestErasureCodeBenchmarkThroughput | |
| hadoop.hdfs.TestExternalBlockReader | |
| hadoop.hdfs.TestRemoteBlockReader | |
| hadoop.hdfs.web.TestHttpsFileSystem | |
| hadoop.fs.TestSWebHdfsFileContextMainOperations | |
| hadoop.fs.contract.hdfs.TestHDFSContractOpen | |
| hadoop.hdfs.TestCrcCorruption | |
| hadoop.fs.shell.TestHdfsTextCommand | |
| hadoop.hdfs.server.namenode.TestFileContextAcl | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 | |
| hadoop.hdfs.TestSmallBlock | |
| hadoop.hdfs.TestDFSRollback | |
| hadoop.hdfs.server.namenode.ha.TestHAMetrics | |
| hadoop.hdfs.server.namenode.TestFsck | |
| hadoop.hdfs.server.blockmanagement.TestBlockManager | |
| hadoop.fs.contract.hdfs.TestHDFSContractCreate | |
| hadoop.hdfs.TestDFSStorageStateRecovery | |
| hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer | |
| hadoop.hdfs.server.namenode.TestFSImageWithSnapshot | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics | |
| hadoop.hdfs.TestAbandonBlock | |
| hadoop.hdfs.TestConnCache | |
| hadoop.hdfs.TestReadStripedFileWithDecoding | |
| hadoop.fs.TestFcHdfsSetUMask | |
| hadoop.hdfs.TestFileCorruption | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.namenode.TestFileLimit | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.TestFsShellPermission | |
| hadoop.hdfs.TestEncryptionZones | |
| hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting | |
| hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation | |
| hadoop.hdfs.TestParallelShortCircuitLegacyRead | |
| hadoop.hdfs.TestFileAppend4 | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks | |
| hadoop.hdfs.TestDFSFinalize | |
| hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages | |
| hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart | |
| hadoop.hdfs.TestLocalDFS | |
| hadoop.hdfs.server.datanode.TestCachingStrategy | |
| hadoop.hdfs.server.namenode.TestDeadDatanode | |
| hadoop.hdfs.server.datanode.TestReadOnlySharedStorage | |
| hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot | |
| hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock | |
| hadoop.fs.TestSymlinkHdfsDisable | |
| hadoop.hdfs.TestBlockMissingException | |
| hadoop.hdfs.TestFileAppend3 | |
| hadoop.hdfs.TestFileStatus | |
| hadoop.hdfs.TestQuota | |
| hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy | |
| hadoop.fs.TestSymlinkHdfsFileSystem | |
| hadoop.hdfs.TestListFilesInDFS | |
| hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs | |
| hadoop.hdfs.TestFileLengthOnClusterRestart | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| hadoop.hdfs.server.namenode.TestFSDirectory | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 | |
| hadoop.hdfs.server.namenode.TestNameEditsConfigs | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters | |
| hadoop.hdfs.web.TestWebHDFSXAttr | |
| hadoop.hdfs.crypto.TestHdfsCryptoStreams | |
| hadoop.fs.contract.hdfs.TestHDFSContractConcat | |
| hadoop.hdfs.web.TestWebHDFSAcl | |
| hadoop.hdfs.TestDataTransferProtocol | |
| hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade | |
| hadoop.hdfs.TestRollingUpgrade | |
| hadoop.hdfs.server.datanode.TestBlockScanner | |
| hadoop.hdfs.tools.TestDebugAdmin | |
| hadoop.hdfs.server.namenode.TestStartup | |
| hadoop.hdfs.TestDFSStripedOutputStream | |
| hadoop.hdfs.TestBalancerBandwidth | |
| hadoop.security.TestPermissionSymlinks | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing | |
| hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks | |
| hadoop.hdfs.TestInjectionForSimulatedStorage | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040 | |
| hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot | |
| hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer | |
| hadoop.fs.viewfs.TestViewFsHdfs | |
| hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | |
| hadoop.hdfs.server.namenode.ha.TestHAStateTransitions | |
| hadoop.hdfs.web.TestWebHDFS | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport | |
| hadoop.hdfs.TestDFSPermission | |
| hadoop.hdfs.TestFileCreation | |
| hadoop.fs.viewfs.TestViewFsAtHdfsRoot | |
| hadoop.fs.TestEnhancedByteBufferAccess | |
| hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting | |
| hadoop.hdfs.TestDFSInotifyEventInputStream | |
| hadoop.hdfs.server.datanode.TestIncrementalBrVariations | |
| hadoop.hdfs.server.namenode.TestAddBlockRetry | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 | |
| hadoop.fs.contract.hdfs.TestHDFSContractAppend | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120 | |
| hadoop.hdfs.TestDFSClientExcludedNodes | |
| hadoop.fs.TestSymlinkHdfsFileContext | |
| hadoop.hdfs.TestErasureCodingPolicyWithSnapshot | |
| hadoop.hdfs.TestSafeModeWithStripedFile | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles | |
| hadoop.hdfs.server.namenode.TestProcessCorruptBlocks | |
| hadoop.hdfs.TestParallelRead | |
| hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots | |
| hadoop.hdfs.TestWriteRead | |
| hadoop.hdfs.TestPread | |
| hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.TestRestartDFS | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.tracing.TestTracing | |
| hadoop.hdfs.TestReservedRawPaths | |
| hadoop.hdfs.TestGetFileChecksum | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshot | |
| hadoop.hdfs.server.namenode.TestReconstructStripedBlocks | |
| hadoop.hdfs.server.datanode.TestFsDatasetCache | |
| hadoop.hdfs.TestEncryptionZonesWithHA | |
| hadoop.hdfs.server.datanode.TestIncrementalBlockReports | |
| hadoop.hdfs.TestDFSInputStream | |
| hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean | |
| hadoop.hdfs.TestDFSMkdirs | |
| hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks | |
| hadoop.hdfs.TestParallelShortCircuitReadNoChecksum | |
| hadoop.fs.TestFcHdfsCreateMkdir | |
| hadoop.hdfs.TestClientReportBadBlock | |
| hadoop.hdfs.server.namenode.ha.TestQuotasWithHA | |
| hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | |
| hadoop.hdfs.TestHFlush | |
| hadoop.hdfs.TestParallelUnixDomainRead | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 | |
| hadoop.hdfs.security.TestDelegationTokenForProxyUser | |
| hadoop.hdfs.server.namenode.TestLargeDirectoryDelete | |
| hadoop.fs.TestUnbuffer | |
| hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement | |
| hadoop.hdfs.TestFileAppendRestart | |
| hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes | |
| hadoop.hdfs.TestRemoteBlockReader2 | |
| hadoop.hdfs.TestSetrepIncreasing | |
| hadoop.hdfs.server.namenode.TestNestedEncryptionZones | |
| hadoop.hdfs.server.namenode.TestAuditLogs | |
| hadoop.hdfs.server.namenode.TestINodeFile | |
| hadoop.hdfs.security.TestDelegationToken | |
| hadoop.hdfs.server.namenode.TestParallelImageWrite | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation | |
| hadoop.hdfs.shortcircuit.TestShortCircuitCache | |
| hadoop.hdfs.TestReadWhileWriting | |
| hadoop.hdfs.TestDFSClientFailover | |
| hadoop.hdfs.server.namenode.TestCacheDirectives | |
| hadoop.fs.loadGenerator.TestLoadGenerator | |
| hadoop.hdfs.TestLease | |
| hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes | |
| hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes | |
| hadoop.hdfs.server.namenode.TestNameNodeAcl | |
| hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup | |
| hadoop.hdfs.TestModTime | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement | |
| hadoop.hdfs.server.namenode.TestNamenodeRetryCache | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot | |
| hadoop.hdfs.server.mover.TestMover | |
| hadoop.fs.contract.hdfs.TestHDFSContractRename | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration | |
| hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.datanode.TestBPOfferService | |
| hadoop.hdfs.TestWriteReadStripedFile | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 | |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| hadoop.hdfs.TestReplaceDatanodeOnFailure | |
| hadoop.hdfs.TestEncryptionZonesWithKMS | |
| hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA | |
| hadoop.hdfs.TestClientBlockVerification | |
| hadoop.hdfs.TestGetBlocks | |
| hadoop.hdfs.server.namenode.TestFileContextXAttr | |
| hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | |
| hadoop.hdfs.server.blockmanagement.TestPendingReplication | |
| hadoop.hdfs.TestSetrepDecreasing | |
| hadoop.hdfs.TestWriteBlockGetsBlockLengthHint | |
| hadoop.hdfs.TestMissingBlocksAlert | |
| hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN | |
| hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 | |
| hadoop.hdfs.security.token.block.TestBlockToken | |
| hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots | |
| hadoop.fs.contract.hdfs.TestHDFSContractMkdir | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.TestDFSShell | |
| hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| hadoop.hdfs.TestDecommission | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 | |
| hadoop.hdfs.TestBlockReaderLocal | |
| hadoop.hdfs.server.namenode.TestNameNodeXAttr | |
| hadoop.hdfs.server.namenode.TestStorageRestore | |
| hadoop.hdfs.TestHDFSFileSystemContract | |
| hadoop.hdfs.TestDFSStartupVersions | |
| hadoop.hdfs.server.blockmanagement.TestNodeCount | |
| hadoop.hdfs.TestAppendSnapshotTruncate | |
| hadoop.hdfs.server.namenode.TestFSImageWithAcl | |
| hadoop.fs.TestHDFSFileContextMainOperations | |
| hadoop.fs.viewfs.TestViewFsDefaultValue | |
| hadoop.hdfs.TestDatanodeDeath | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure | |
| hadoop.hdfs.TestAppendDifferentChecksum | |
| hadoop.hdfs.server.namenode.TestBackupNode | |
| hadoop.hdfs.TestSafeMode | |
| hadoop.hdfs.TestListFilesInFileContext | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.TestSeekBug | |
| hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl | |
| hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency | |
| hadoop.hdfs.server.namenode.TestStripedINodeFile | |
| hadoop.hdfs.TestDisableConnCache | |
| hadoop.hdfs.server.namenode.TestHDFSConcat | |
| hadoop.fs.viewfs.TestViewFileSystemHdfs | |
| hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId | |
| hadoop.hdfs.server.namenode.TestAddBlock | |
| hadoop.hdfs.TestLargeBlock | |
| hadoop.hdfs.TestBlockReaderLocalLegacy | |
| hadoop.hdfs.TestMultiThreadedHflush | |
| hadoop.tracing.TestTracingShortCircuitLocalRead | |
| hadoop.hdfs.web.TestFSMainOperationsWebHdfs | |
| hadoop.hdfs.TestClose | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap | |
| hadoop.hdfs.TestSetTimes | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130 | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter | |
| hadoop.hdfs.server.namenode.TestAddStripedBlocks | |
| hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks | |
| hadoop.hdfs.TestLeaseRecoveryStriped | |
| JDK v1.7.0_95 Timed out junit tests | org.apache.hadoop.hdfs.TestLeaseRecovery2 |
| org.apache.hadoop.hdfs.server.namenode.TestFSImage | |
| org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory | |
| org.apache.hadoop.hdfs.TestDatanodeReport | |
| org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean | |
| org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader | |
| org.apache.hadoop.hdfs.server.namenode.TestDeleteRace | |
| org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion | |
| org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction | |
| org.apache.hadoop.hdfs.TestPersistBlocks | |
| org.apache.hadoop.cli.TestHDFSCLI |
This message was automatically generated.
h9710_20160216b.patch: fixes a bug.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 11s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 5 new or modified test files. |
| +1 | mvninstall | 7m 49s | trunk passed |
| +1 | compile | 0m 57s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 48s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 33s | trunk passed |
| +1 | mvnsite | 1m 1s | trunk passed |
| +1 | mvneclipse | 0m 14s | trunk passed |
| +1 | findbugs | 2m 14s | trunk passed |
| +1 | javadoc | 1m 32s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 2m 12s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 53s | the patch passed |
| +1 | compile | 0m 59s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 59s | the patch passed |
| +1 | compile | 0m 49s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 49s | the patch passed |
| -1 | checkstyle | 0m 33s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 903 unchanged - 2 fixed = 905 total (was 905) |
| +1 | mvnsite | 1m 4s | the patch passed |
| +1 | mvneclipse | 0m 14s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 2m 22s | the patch passed |
| +1 | javadoc | 1m 21s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 2m 5s | the patch passed with JDK v1.7.0_95 |
| -1 | unit | 192m 39s | hadoop-hdfs in the patch failed with JDK v1.8.0_72. |
| -1 | unit | 191m 32s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| -1 | asflicense | 0m 39s | Patch generated 3 ASF License warnings. |
| 415m 18s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_72 Failed junit tests | hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes |
| hadoop.hdfs.server.namenode.TestINodeFile | |
| hadoop.hdfs.server.datanode.TestFsDatasetCache | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.shortcircuit.TestShortCircuitCache | |
| hadoop.hdfs.TestDFSRename | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration | |
| hadoop.hdfs.server.namenode.TestStorageRestore | |
| hadoop.hdfs.server.blockmanagement.TestNodeCount | |
| hadoop.hdfs.TestEncryptionZones | |
| hadoop.hdfs.server.namenode.TestFileContextAcl | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.TestBalancerBandwidth | |
| hadoop.hdfs.TestReadWhileWriting | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.namenode.TestFSImageWithAcl | |
| hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks | |
| hadoop.hdfs.server.namenode.TestAddBlock | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.server.datanode.TestBPOfferService | |
| hadoop.hdfs.TestFileAppendRestart | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter | |
| hadoop.hdfs.server.namenode.TestEditLog | |
| hadoop.hdfs.server.mover.TestMover | |
| hadoop.hdfs.TestSafeMode | |
| hadoop.hdfs.server.namenode.TestHDFSConcat | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS | |
| hadoop.hdfs.server.namenode.TestFSImageWithXAttr | |
| hadoop.hdfs.TestRollingUpgrade | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.namenode.TestQuotaByStorageType | |
| hadoop.hdfs.TestFileCreation | |
| hadoop.hdfs.server.namenode.ha.TestQuotasWithHA | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting | |
| hadoop.hdfs.server.namenode.ha.TestHAStateTransitions | |
| hadoop.hdfs.TestModTime | |
| hadoop.hdfs.TestAppendSnapshotTruncate | |
| hadoop.hdfs.TestRestartDFS | |
| hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade | |
| hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation | |
| hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints | |
| hadoop.hdfs.server.namenode.TestAddStripedBlocks | |
| hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| hadoop.hdfs.TestReconstructStripedFile | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | |
| hadoop.hdfs.server.namenode.TestCheckpoint | |
| hadoop.hdfs.server.namenode.TestDeadDatanode | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.web.TestWebHDFSAcl | |
| hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots | |
| hadoop.hdfs.TestErasureCodingPolicyWithSnapshot | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer | |
| hadoop.hdfs.server.namenode.TestNestedEncryptionZones | |
| hadoop.hdfs.server.namenode.TestStartup | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean | |
| hadoop.hdfs.TestLeaseRecovery | |
| hadoop.hdfs.TestFileLengthOnClusterRestart | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.web.TestWebHDFS | |
| hadoop.hdfs.server.namenode.TestProcessCorruptBlocks | |
| hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock | |
| hadoop.hdfs.server.namenode.TestCacheDirectives | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap | |
| hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication | |
| hadoop.hdfs.server.namenode.TestHostsFiles | |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled | |
| hadoop.hdfs.server.datanode.TestDataNodeMetrics | |
| hadoop.fs.TestEnhancedByteBufferAccess | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure | |
| hadoop.hdfs.security.TestDelegationToken | |
| hadoop.hdfs.TestEncryptionZonesWithKMS | |
| hadoop.hdfs.TestDFSInotifyEventInputStream | |
| hadoop.hdfs.TestSetrepIncreasing | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.server.datanode.TestReadOnlySharedStorage | |
| hadoop.hdfs.TestLeaseRecoveryStriped | |
| hadoop.hdfs.server.namenode.ha.TestHAMetrics | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy | |
| hadoop.hdfs.server.namenode.TestAddBlockRetry | |
| hadoop.hdfs.TestSafeModeWithStripedFile | |
| hadoop.hdfs.TestSetrepDecreasing | |
| hadoop.hdfs.TestFileAppend4 | |
| hadoop.hdfs.TestDFSRemove | |
| hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting | |
| hadoop.hdfs.TestExternalBlockReader | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.hdfs.TestAbandonBlock | |
| hadoop.hdfs.TestDataTransferKeepalive | |
| hadoop.hdfs.TestHDFSTrash | |
| hadoop.hdfs.server.namenode.TestNameNodeAcl | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| JDK v1.8.0_72 Timed out junit tests | org.apache.hadoop.hdfs.TestLeaseRecovery2 |
| org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool | |
| org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer | |
| org.apache.hadoop.hdfs.TestReplication | |
| org.apache.hadoop.hdfs.TestDatanodeDeath | |
| org.apache.hadoop.hdfs.server.namenode.TestFSImage | |
| org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage | |
| org.apache.hadoop.hdfs.TestDecommission | |
| org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks | |
| org.apache.hadoop.hdfs.server.namenode.TestFsck | |
| org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| org.apache.hadoop.hdfs.server.namenode.TestFileTruncate | |
| org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes | |
| org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory | |
| org.apache.hadoop.hdfs.server.balancer.TestBalancer | |
| org.apache.hadoop.hdfs.TestDatanodeReport | |
| org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean | |
| org.apache.hadoop.hdfs.server.datanode.TestDiskError | |
| org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache | |
| org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader | |
| org.apache.hadoop.hdfs.server.namenode.TestDeleteRace | |
| org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion | |
| org.apache.hadoop.cli.TestHDFSCLI | |
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes |
| hadoop.hdfs.server.namenode.TestINodeFile | |
| hadoop.hdfs.server.datanode.TestFsDatasetCache | |
| hadoop.hdfs.server.namenode.ha.TestHASafeMode | |
| hadoop.hdfs.shortcircuit.TestShortCircuitCache | |
| hadoop.hdfs.TestDFSRename | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration | |
| hadoop.hdfs.server.namenode.TestStorageRestore | |
| hadoop.hdfs.server.blockmanagement.TestNodeCount | |
| hadoop.hdfs.TestEncryptionZones | |
| hadoop.hdfs.server.namenode.TestFileContextAcl | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | |
| hadoop.hdfs.TestBalancerBandwidth | |
| hadoop.hdfs.TestReadWhileWriting | |
| hadoop.hdfs.TestFileAppend2 | |
| hadoop.hdfs.server.mover.TestStorageMover | |
| hadoop.hdfs.server.namenode.TestFSImageWithAcl | |
| hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks | |
| hadoop.hdfs.server.namenode.TestAddBlock | |
| hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | |
| hadoop.hdfs.server.datanode.TestBPOfferService | |
| hadoop.hdfs.TestFileAppendRestart | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter | |
| hadoop.hdfs.server.namenode.TestEditLog | |
| hadoop.hdfs.server.mover.TestMover | |
| hadoop.hdfs.TestSafeMode | |
| hadoop.hdfs.server.namenode.TestHDFSConcat | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS | |
| hadoop.hdfs.server.namenode.TestFSImageWithXAttr | |
| hadoop.hdfs.TestRollingUpgrade | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.namenode.TestQuotaByStorageType | |
| hadoop.hdfs.TestFileCreation | |
| hadoop.hdfs.server.namenode.ha.TestQuotasWithHA | |
| hadoop.hdfs.qjournal.TestSecureNNWithQJM | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting | |
| hadoop.hdfs.server.namenode.ha.TestHAStateTransitions | |
| hadoop.hdfs.TestModTime | |
| hadoop.hdfs.TestAppendSnapshotTruncate | |
| hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade | |
| hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation | |
| hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints | |
| hadoop.fs.viewfs.TestViewFsDefaultValue | |
| hadoop.hdfs.server.namenode.TestAddStripedBlocks | |
| hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | |
| hadoop.hdfs.TestReconstructStripedFile | |
| hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | |
| hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | |
| hadoop.hdfs.server.namenode.TestCheckpoint | |
| hadoop.hdfs.server.namenode.TestDeadDatanode | |
| hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | |
| hadoop.hdfs.web.TestWebHDFSAcl | |
| hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots | |
| hadoop.hdfs.TestErasureCodingPolicyWithSnapshot | |
| hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | |
| hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer | |
| hadoop.hdfs.server.namenode.TestNestedEncryptionZones | |
| hadoop.hdfs.server.namenode.TestStartup | |
| hadoop.hdfs.server.datanode.TestBlockReplacement | |
| hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean | |
| hadoop.hdfs.TestLeaseRecovery | |
| hadoop.hdfs.TestFileLengthOnClusterRestart | |
| hadoop.hdfs.TestFileAppend | |
| hadoop.hdfs.web.TestWebHDFS | |
| hadoop.hdfs.server.namenode.TestProcessCorruptBlocks | |
| hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock | |
| hadoop.hdfs.server.namenode.TestCacheDirectives | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap | |
| hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer | |
| hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | |
| hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage | |
| hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication | |
| hadoop.hdfs.server.namenode.TestHostsFiles | |
| hadoop.hdfs.server.namenode.TestEditLogRace | |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled | |
| hadoop.hdfs.server.datanode.TestDataNodeMetrics | |
| hadoop.fs.TestEnhancedByteBufferAccess | |
| hadoop.hdfs.TestPersistBlocks | |
| hadoop.hdfs.TestDFSStripedOutputStreamWithFailure | |
| hadoop.hdfs.security.TestDelegationToken | |
| hadoop.hdfs.TestEncryptionZonesWithKMS | |
| hadoop.hdfs.TestDFSInotifyEventInputStream | |
| hadoop.hdfs.TestSetrepIncreasing | |
| hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | |
| hadoop.hdfs.server.datanode.TestReadOnlySharedStorage | |
| hadoop.hdfs.TestLeaseRecoveryStriped | |
| hadoop.hdfs.server.namenode.ha.TestHAMetrics | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy | |
| hadoop.hdfs.server.namenode.TestAddBlockRetry | |
| hadoop.hdfs.TestSetrepDecreasing | |
| hadoop.hdfs.TestFileAppend4 | |
| hadoop.hdfs.TestDFSRemove | |
| hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting | |
| hadoop.hdfs.TestBlockStoragePolicy | |
| hadoop.hdfs.TestAbandonBlock | |
| hadoop.hdfs.server.namenode.TestNameNodeAcl | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation | |
| hadoop.hdfs.TestEncryptedTransfer | |
| hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | |
| hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup | |
| hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | |
| JDK v1.7.0_95 Timed out junit tests | org.apache.hadoop.hdfs.TestLeaseRecovery2 |
| org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool | |
| org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer | |
| org.apache.hadoop.hdfs.TestReplication | |
| org.apache.hadoop.hdfs.TestDatanodeDeath | |
| org.apache.hadoop.hdfs.server.namenode.TestFSImage | |
| org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage | |
| org.apache.hadoop.hdfs.TestDecommission | |
| org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks | |
| org.apache.hadoop.hdfs.server.namenode.TestFsck | |
| org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| org.apache.hadoop.hdfs.server.namenode.TestFileTruncate | |
| org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes | |
| org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory | |
| org.apache.hadoop.hdfs.server.balancer.TestBalancer | |
| org.apache.hadoop.hdfs.TestDatanodeReport | |
| org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean | |
| org.apache.hadoop.hdfs.server.datanode.TestDiskError | |
| org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache | |
| org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader | |
| org.apache.hadoop.hdfs.server.namenode.TestDeleteRace | |
| org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion | |
| org.apache.hadoop.cli.TestHDFSCLI |
This message was automatically generated.
h9710_20160217.patch: fixes a bug that the wait time is set to 0 when ibrInterval == 0.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 13s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 5 new or modified test files. |
| +1 | mvninstall | 9m 29s | trunk passed |
| +1 | compile | 1m 7s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 58s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 44s | trunk passed |
| +1 | mvnsite | 1m 10s | trunk passed |
| +1 | mvneclipse | 0m 18s | trunk passed |
| +1 | findbugs | 2m 31s | trunk passed |
| +1 | javadoc | 1m 34s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 2m 32s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 1m 3s | the patch passed |
| +1 | compile | 1m 5s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 1m 5s | the patch passed |
| +1 | compile | 0m 56s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 56s | the patch passed |
| -1 | checkstyle | 0m 40s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 903 unchanged - 2 fixed = 905 total (was 905) |
| +1 | mvnsite | 1m 7s | the patch passed |
| +1 | mvneclipse | 0m 16s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 2m 46s | the patch passed |
| +1 | javadoc | 1m 37s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 2m 36s | the patch passed with JDK v1.7.0_95 |
| -1 | unit | 88m 43s | hadoop-hdfs in the patch failed with JDK v1.8.0_72. |
| -1 | unit | 79m 40s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 29s | Patch does not generate ASF License warnings. |
| 204m 36s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_72 Failed junit tests | hadoop.hdfs.server.datanode.TestDataNodeMetrics |
| hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.hdfs.security.TestDelegationTokenForProxyUser | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint | |
| JDK v1.8.0_72 Timed out junit tests | org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot |
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.blockmanagement.TestBlockManagerSafeMode |
| hadoop.hdfs.shortcircuit.TestShortCircuitCache | |
| hadoop.hdfs.server.namenode.ha.TestDNFencing | |
| hadoop.hdfs.server.datanode.TestTriggerBlockReport | |
| hadoop.hdfs.server.namenode.TestDecommissioningStatus | |
| hadoop.hdfs.server.datanode.TestDirectoryScanner | |
| hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs | |
| hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint |
This message was automatically generated.
h9710_20160219.patch: fixes test failures.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 14s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 6 new or modified test files. |
| +1 | mvninstall | 6m 39s | trunk passed |
| +1 | compile | 0m 37s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 41s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 32s | trunk passed |
| +1 | mvnsite | 0m 51s | trunk passed |
| +1 | mvneclipse | 0m 13s | trunk passed |
| +1 | findbugs | 1m 53s | trunk passed |
| +1 | javadoc | 1m 6s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 45s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 45s | the patch passed |
| +1 | compile | 0m 35s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 35s | the patch passed |
| +1 | compile | 0m 37s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 37s | the patch passed |
| -1 | checkstyle | 0m 30s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 908 unchanged - 2 fixed = 910 total (was 910) |
| +1 | mvnsite | 0m 49s | the patch passed |
| +1 | mvneclipse | 0m 11s | the patch passed |
| -1 | whitespace | 0m 0s | The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. |
| +1 | findbugs | 2m 6s | the patch passed |
| +1 | javadoc | 1m 3s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 41s | the patch passed with JDK v1.7.0_95 |
| +1 | unit | 64m 30s | hadoop-hdfs in the patch passed with JDK v1.8.0_72. |
| -1 | unit | 65m 26s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 24s | Patch does not generate ASF License warnings. |
| 155m 14s |
| Reason | Tests |
|---|---|
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot |
| Subsystem | Report/Notes |
|---|---|
| Docker | Image:yetus/hadoop:0ca8df7 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12788774/h9710_20160219.patch |
| JIRA Issue | |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle |
| uname | Linux d43eb5e16169 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 66289a3 |
| Default Java | 1.7.0_95 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 |
| findbugs | v3.0.0 |
| checkstyle | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt |
| whitespace | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/artifact/patchprocess/whitespace-eol.txt |
| unit | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt |
| unit test logs | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt |
| JDK v1.7.0_95 Test Results | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/testReport/ |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs |
| Console output | https://builds.apache.org/job/PreCommit-HDFS-Build/14567/console |
| Powered by | Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 14s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 6 new or modified test files. |
| +1 | mvninstall | 6m 28s | trunk passed |
| +1 | compile | 0m 38s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 40s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 31s | trunk passed |
| +1 | mvnsite | 0m 51s | trunk passed |
| +1 | mvneclipse | 0m 13s | trunk passed |
| +1 | findbugs | 1m 52s | trunk passed |
| +1 | javadoc | 1m 4s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 47s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 46s | the patch passed |
| +1 | compile | 0m 37s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 37s | the patch passed |
| +1 | compile | 0m 38s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 38s | the patch passed |
| -1 | checkstyle | 0m 30s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 908 unchanged - 2 fixed = 910 total (was 910) |
| +1 | mvnsite | 0m 49s | the patch passed |
| +1 | mvneclipse | 0m 11s | the patch passed |
| -1 | whitespace | 0m 0s | The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. |
| +1 | findbugs | 2m 4s | the patch passed |
| +1 | javadoc | 1m 3s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 46s | the patch passed with JDK v1.7.0_95 |
| -1 | unit | 66m 3s | hadoop-hdfs in the patch failed with JDK v1.8.0_72. |
| -1 | unit | 67m 38s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 20s | Patch does not generate ASF License warnings. |
| 158m 46s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_72 Failed junit tests | hadoop.hdfs.server.namenode.TestReconstructStripedBlocks |
| hadoop.hdfs.TestDFSUpgradeFromImage | |
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness |
This message was automatically generated.
Thanks for working on this, Nicholas! The patch looks good to me. Some comments:
- In IncrementalBlockReportManager#sendIBRs, the "isDebugEnabled" check can be skipped since we're using slf4j.Logger.
- We can add some new unit tests for the new feature/configuration.
> 1. In IncrementalBlockReportManager#sendIBRs, the "isDebugEnabled" check can be skipped since we're using slf4j.Logger.
The log message uses Arrays.toString(..) so that log("{}", Arrays.toString(reports) does not work well. It will create the string even if the log is not enabled.
h9710_20160224.patch: adds a test.
The new test shows that #IBR is greater decreased from ~550 calls to 41 calls.
- Batch mode IBR
2016-02-24 18:46:04,197 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:runIbrTest(134)) - batchModeIbr=true, duration=6.487ms, createFileTime=68.188ms, verifyFileTime=35.348ms 2016-02-24 18:46:04,351 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:57961: IncrementalBlockReportsNumOps=41 2016-02-24 18:46:04,362 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:57965: IncrementalBlockReportsNumOps=41 2016-02-24 18:46:04,374 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:57970: IncrementalBlockReportsNumOps=41 2016-02-24 18:46:04,386 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:57974: IncrementalBlockReportsNumOps=41 - Immediate IBR
2016-02-24 18:46:10,748 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:runIbrTest(134)) - batchModeIbr=false, duration=4.678ms, createFileTime=67.169ms, verifyFileTime=7.548ms 2016-02-24 18:46:10,756 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:61066: IncrementalBlockReportsNumOps=553 2016-02-24 18:46:10,764 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:61071: IncrementalBlockReportsNumOps=561 2016-02-24 18:46:10,772 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:61075: IncrementalBlockReportsNumOps=558 2016-02-24 18:46:10,780 [main] INFO datanode.TestBatchIbr (TestBatchIbr.java:logIbrCounts(154)) - 127.0.0.1:61079: IncrementalBlockReportsNumOps=558
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 11s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 7 new or modified test files. |
| +1 | mvninstall | 6m 33s | trunk passed |
| +1 | compile | 0m 40s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 40s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 31s | trunk passed |
| +1 | mvnsite | 0m 53s | trunk passed |
| +1 | mvneclipse | 0m 13s | trunk passed |
| +1 | findbugs | 1m 52s | trunk passed |
| +1 | javadoc | 1m 6s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 47s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 44s | the patch passed |
| +1 | compile | 0m 38s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 38s | the patch passed |
| +1 | compile | 0m 37s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 37s | the patch passed |
| -1 | checkstyle | 0m 28s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 907 unchanged - 2 fixed = 909 total (was 909) |
| +1 | mvnsite | 0m 49s | the patch passed |
| +1 | mvneclipse | 0m 12s | the patch passed |
| -1 | whitespace | 0m 0s | The patch has 8 line(s) that end in whitespace. Use git apply --whitespace=fix. |
| +1 | findbugs | 2m 8s | the patch passed |
| +1 | javadoc | 0m 59s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 42s | the patch passed with JDK v1.7.0_95 |
| +1 | unit | 54m 56s | hadoop-hdfs in the patch passed with JDK v1.8.0_72. |
| -1 | unit | 57m 34s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 21s | Patch does not generate ASF License warnings. |
| 137m 34s |
| Reason | Tests |
|---|---|
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.datanode.TestFsDatasetCache |
| hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs | |
| hadoop.hdfs.TestRollingUpgrade | |
| JDK v1.7.0_95 Timed out junit tests | org.apache.hadoop.hdfs.TestLeaseRecovery2 |
| Subsystem | Report/Notes |
|---|---|
| Docker | Image:yetus/hadoop:0ca8df7 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12789852/h9710_20160224.patch |
| JIRA Issue | |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle |
| uname | Linux fd69d403839d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 6979cbf |
| Default Java | 1.7.0_95 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 |
| findbugs | v3.0.0 |
| checkstyle | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt |
| whitespace | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/artifact/patchprocess/whitespace-eol.txt |
| unit | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt |
| unit test logs | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt |
| JDK v1.7.0_95 Test Results | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/testReport/ |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs |
| Console output | https://builds.apache.org/job/PreCommit-HDFS-Build/14611/console |
| Powered by | Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
h9710_20160225.patch: slightly changes the test.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 10s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 7 new or modified test files. |
| +1 | mvninstall | 6m 23s | trunk passed |
| +1 | compile | 0m 37s | trunk passed with JDK v1.8.0_72 |
| +1 | compile | 0m 40s | trunk passed with JDK v1.7.0_95 |
| +1 | checkstyle | 0m 32s | trunk passed |
| +1 | mvnsite | 0m 49s | trunk passed |
| +1 | mvneclipse | 0m 14s | trunk passed |
| +1 | findbugs | 1m 54s | trunk passed |
| +1 | javadoc | 1m 4s | trunk passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 47s | trunk passed with JDK v1.7.0_95 |
| +1 | mvninstall | 0m 46s | the patch passed |
| +1 | compile | 0m 39s | the patch passed with JDK v1.8.0_72 |
| +1 | javac | 0m 39s | the patch passed |
| +1 | compile | 0m 40s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 0m 40s | the patch passed |
| -1 | checkstyle | 0m 28s | hadoop-hdfs-project/hadoop-hdfs: patch generated 2 new + 910 unchanged - 2 fixed = 912 total (was 912) |
| +1 | mvnsite | 0m 49s | the patch passed |
| +1 | mvneclipse | 0m 11s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 2m 14s | the patch passed |
| +1 | javadoc | 1m 12s | the patch passed with JDK v1.8.0_72 |
| +1 | javadoc | 1m 52s | the patch passed with JDK v1.7.0_95 |
| -1 | unit | 55m 26s | hadoop-hdfs in the patch failed with JDK v1.8.0_72. |
| -1 | unit | 55m 9s | hadoop-hdfs in the patch failed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 21s | Patch does not generate ASF License warnings. |
| 136m 3s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_72 Failed junit tests | hadoop.hdfs.TestFileCreation |
| JDK v1.7.0_95 Failed junit tests | hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness |
This message was automatically generated.
The latest patch looks good to me. +1. Thanks for the work Nicholas!
Thanks Jing for reviewing the patches.
I have committed this.
FAILURE: Integrated in Hadoop-trunk-Commit #9379 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9379/)
HDFS-9710. DN can be configured to send block receipt IBRs in batches. (szetszwo: rev d1d4e16690cc85f7f22fbead9cf596260819b561)
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/extdataset/ExternalDatasetImpl.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataXceiverLazyPersistHint.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBPOfferService.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/SimulatedFSDataset.java
- hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/IncrementalBlockReportManager.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/protocol/StorageReceivedDeletedBlocks.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBatchIbr.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPOfferService.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestInterDatanodeProtocol.java
- hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestIncrementalBlockReports.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DNConf.java
- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java
I just committed this to branch-2.7. Thank you Vinitha Reddy Gankidi for backport.
Attaching final patch for backport to 2.7.4.
Created
HDFS-9726for code refactoring.