Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14866

Backport implementation of parallel block copy in Distcp to hadoop 2.8

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: tools/distcp
    • Labels:
      None
    • Target Version/s:

      Description

      The implementation of parallel block copy in Distcp targets to version 2.9. It would be great to have this feature in version 2.8.

      1. HADOOP-14866.001.branch.2.8.patch
        75 kB
        Huafeng Wang
      2. HADOOP-14866.001.branch-2.8.patch
        75 kB
        Huafeng Wang

        Issue Links

          Activity

          Hide
          HuafengWang Huafeng Wang added a comment -

          The first patch is attached. Most of the code credit to Yongjun Zhang.

          Show
          HuafengWang Huafeng Wang added a comment - The first patch is attached. Most of the code credit to Yongjun Zhang .
          Hide
          drankye Kai Zheng added a comment -

          The backport of the nice enhancement and optimization for DistCp to 2.8.x sounds good to me. Junping Du and Yongjun Zhang, would you share your thoughts? Thanks!

          Show
          drankye Kai Zheng added a comment - The backport of the nice enhancement and optimization for DistCp to 2.8.x sounds good to me. Junping Du and Yongjun Zhang , would you share your thoughts? Thanks!
          Hide
          djp Junping Du added a comment -

          Thanks for notifying me, Kai Zheng. While I fully agree this is a very nice enhancement to land on 2.8.x branches, but considering 2.8.2 is in RC stage, I will recommend to commit to branch-2.8 only to get released in 2.8.3. Make sense?

          Show
          djp Junping Du added a comment - Thanks for notifying me, Kai Zheng . While I fully agree this is a very nice enhancement to land on 2.8.x branches, but considering 2.8.2 is in RC stage, I will recommend to commit to branch-2.8 only to get released in 2.8.3. Make sense?
          Hide
          djp Junping Du added a comment -

          Also drop the fix version as the patch hasn't get landed.

          Show
          djp Junping Du added a comment - Also drop the fix version as the patch hasn't get landed.
          Hide
          HuafengWang Huafeng Wang added a comment -

          Replaced the original patch with one targeting to branch 2.8

          Show
          HuafengWang Huafeng Wang added a comment - Replaced the original patch with one targeting to branch 2.8
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          -1 patch 2m 25s HADOOP-14866 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



          Subsystem Report/Notes
          JIRA Issue HADOOP-14866
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887037/HADOOP-14866.001.branch.2.8.patch
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/13287/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 2m 25s HADOOP-14866 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Issue HADOOP-14866 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887037/HADOOP-14866.001.branch.2.8.patch Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/13287/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 11m 30s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
                branch-2.8 Compile Tests
          0 mvndep 0m 18s Maven dependency ordering for branch
          +1 mvninstall 10m 9s branch-2.8 passed
          +1 compile 8m 17s branch-2.8 passed
          +1 checkstyle 1m 22s branch-2.8 passed
          +1 mvnsite 1m 28s branch-2.8 passed
          +1 findbugs 2m 59s branch-2.8 passed
          +1 javadoc 1m 37s branch-2.8 passed
                Patch Compile Tests
          0 mvndep 0m 24s Maven dependency ordering for patch
          +1 mvninstall 1m 24s the patch passed
          +1 compile 8m 25s the patch passed
          +1 javac 8m 24s the patch passed
          +1 checkstyle 1m 17s root: The patch generated 0 new + 246 unchanged - 12 fixed = 246 total (was 258)
          +1 mvnsite 1m 28s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 16s the patch passed
          +1 javadoc 1m 33s the patch passed
                Other Tests
          -1 unit 725m 26s hadoop-hdfs in the patch failed.
          -1 unit 106m 45s hadoop-distcp in the patch failed.
          -1 asflicense 14m 49s The patch generated 2 ASF License warnings.
          930m 6s



          Reason Tests
          Failed junit tests hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.namenode.TestEditLogRace
            hadoop.hdfs.server.datanode.TestDataNodeUUID
            hadoop.hdfs.TestDFSRename
            hadoop.hdfs.TestDatanodeConfig
            hadoop.hdfs.server.namenode.TestQuotaByStorageType
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
            hadoop.hdfs.TestDFSClientRetries
            hadoop.hdfs.TestFileCreationDelete
            hadoop.hdfs.TestFileConcurrentReader
            hadoop.hdfs.TestFileAppend2
            hadoop.hdfs.tools.TestDFSAdmin
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.hdfs.server.namenode.TestMetaSave
            hadoop.hdfs.TestLeaseRecovery
            hadoop.hdfs.TestClientProtocolForPipelineRecovery
            hadoop.hdfs.server.namenode.TestGenericJournalConf
            hadoop.hdfs.TestWriteConfigurationToDFS
            hadoop.hdfs.tools.TestStoragePolicyCommands
            hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
            hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
            hadoop.hdfs.server.namenode.TestAclConfigFlag
            hadoop.hdfs.TestPipelines
            hadoop.hdfs.web.TestHftpFileSystem
            hadoop.hdfs.TestFileCreationClient
            hadoop.hdfs.TestParallelShortCircuitRead
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
            hadoop.hdfs.TestRollingUpgradeRollback
            hadoop.hdfs.server.namenode.TestListOpenFiles
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
            hadoop.hdfs.TestTrashWithSecureEncryptionZones
            hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
            hadoop.hdfs.server.namenode.TestMalformedURLs
            hadoop.hdfs.server.namenode.TestFSImageWithXAttr
            hadoop.hdfs.server.namenode.TestSnapshotPathINodes
            hadoop.hdfs.tools.TestDFSAdminWithHA
            hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.hdfs.TestDataTransferKeepalive
            hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
            hadoop.hdfs.TestDistributedFileSystem
            hadoop.hdfs.TestExternalBlockReader
            hadoop.hdfs.server.namenode.TestAuditLogger
            hadoop.hdfs.client.impl.TestBlockReaderLocal
            hadoop.hdfs.TestSecureEncryptionZoneWithKMS
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
            hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
            hadoop.hdfs.TestHdfsAdmin
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
            hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
            hadoop.hdfs.web.TestWebHdfsTokens
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
            hadoop.hdfs.TestAbandonBlock
            hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
            hadoop.hdfs.TestConnCache
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.TestFsShellPermission
            hadoop.hdfs.TestExtendedAcls
            hadoop.hdfs.TestEncryptionZones
            hadoop.hdfs.TestRollingUpgradeDowngrade
            hadoop.hdfs.client.impl.TestBlockReaderRemote
            hadoop.hdfs.TestLocalDFS
            hadoop.hdfs.server.namenode.TestGetBlockLocations
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.TestBlockMissingException
            hadoop.hdfs.TestFileAppend3
            hadoop.hdfs.TestFileStatus
            hadoop.hdfs.server.namenode.TestINodeAttributeProvider
            hadoop.hdfs.TestListFilesInDFS
            hadoop.hdfs.TestFileLengthOnClusterRestart
            hadoop.hdfs.server.namenode.TestFSDirectory
            hadoop.hdfs.server.namenode.TestCreateEditsLog
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
            hadoop.hdfs.web.TestWebHDFSXAttr
            hadoop.hdfs.crypto.TestHdfsCryptoStreams
            hadoop.hdfs.web.TestWebHDFSAcl
            hadoop.hdfs.TestDataTransferProtocol
            hadoop.hdfs.TestRollingUpgrade
            hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
            hadoop.hdfs.TestPersistBlocks
            hadoop.hdfs.TestDFSAddressConfig
            hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
            hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
            hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
            hadoop.hdfs.TestListPathServlet
            hadoop.hdfs.web.TestWebHDFSForHA
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
            hadoop.hdfs.TestDFSPermission
            hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
            hadoop.hdfs.TestDFSInotifyEventInputStream
            hadoop.hdfs.server.namenode.TestEditLogJournalFailures
            hadoop.hdfs.TestFileAppend
            hadoop.hdfs.TestDFSClientExcludedNodes
            hadoop.hdfs.client.impl.TestClientBlockVerification
            hadoop.hdfs.server.balancer.TestBalancerRPCDelay
            hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
            hadoop.hdfs.TestParallelRead
            hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
            hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
            hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
            hadoop.hdfs.TestReservedRawPaths
            hadoop.hdfs.TestGetFileChecksum
            hadoop.hdfs.server.namenode.snapshot.TestSnapshot
            hadoop.hdfs.TestEncryptionZonesWithHA
            hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
            hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
            hadoop.hdfs.TestClientReportBadBlock
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotManager
            hadoop.hdfs.TestHFlush
            hadoop.hdfs.TestParallelUnixDomainRead
            hadoop.hdfs.TestDatanodeReport
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
            hadoop.hdfs.TestDatanodeLayoutUpgrade
            hadoop.hdfs.TestDFSShellGenericOptions
            hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
            hadoop.hdfs.TestFileAppendRestart
            hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
            hadoop.hdfs.server.namenode.TestSaveNamespace
            hadoop.hdfs.server.namenode.TestNestedEncryptionZones
            hadoop.hdfs.server.namenode.TestINodeFile
            hadoop.hdfs.client.impl.TestBlockReaderRemote2
            hadoop.hdfs.security.TestDelegationToken
            hadoop.hdfs.shortcircuit.TestShortCircuitCache
            hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
            hadoop.hdfs.TestReadWhileWriting
            hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
            hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
            hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.TestModTime
            hadoop.hdfs.server.namenode.TestNameNodeMXBean
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
            hadoop.hdfs.TestEncryptedTransfer
            hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
            hadoop.hdfs.server.mover.TestMover
            hadoop.hdfs.util.TestDiff
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
            hadoop.hdfs.TestFetchImage
            hadoop.hdfs.TestReplaceDatanodeOnFailure
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.hdfs.TestGetBlocks
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.server.namenode.TestDeleteRace
            hadoop.hdfs.client.impl.TestBlockReaderFactory
            hadoop.hdfs.TestDataStream
            hadoop.hdfs.TestSetrepDecreasing
            hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
            hadoop.hdfs.TestMissingBlocksAlert
            hadoop.hdfs.security.token.block.TestBlockToken
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.TestDFSShell
            hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.hdfs.server.namenode.TestMetadataVersionOutput
            hadoop.hdfs.server.namenode.TestNameNodeXAttr
            hadoop.hdfs.TestHDFSFileSystemContract
            hadoop.hdfs.server.blockmanagement.TestNodeCount
            hadoop.hdfs.TestAppendSnapshotTruncate
            hadoop.hdfs.server.namenode.TestFSImageWithAcl
            hadoop.hdfs.TestFileCreationEmpty
            hadoop.hdfs.server.namenode.TestBackupNode
            hadoop.hdfs.TestSafeMode
            hadoop.hdfs.TestListFilesInFileContext
            hadoop.hdfs.TestSeekBug
            hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
            hadoop.hdfs.TestLargeBlock
            hadoop.hdfs.TestMultiThreadedHflush
            hadoop.hdfs.web.TestFSMainOperationsWebHdfs
            hadoop.hdfs.TestClose
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
            hadoop.hdfs.TestSetTimes
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.tools.TestIntegration
            hadoop.tools.TestDistCpSystem
            hadoop.tools.util.TestThrottledInputStream
            hadoop.tools.TestDistCpViewFs
          Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
            org.apache.hadoop.hdfs.server.datanode.TestHSync
            org.apache.hadoop.hdfs.server.namenode.TestStartup
            org.apache.hadoop.hdfs.TestDFSStartupVersions
            org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
            org.apache.hadoop.hdfs.TestWriteRead
            org.apache.hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool
            org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
            org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
            org.apache.hadoop.hdfs.TestDatanodeRegistration
            org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager
            org.apache.hadoop.hdfs.server.namenode.TestNameNodeHttpServer
            org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
            org.apache.hadoop.hdfs.TestBlocksScheduledCounter
            org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
            org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl
            org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeExit
            org.apache.hadoop.hdfs.TestDFSClientFailover
            org.apache.hadoop.fs.TestEnhancedByteBufferAccess
            org.apache.hadoop.hdfs.TestSetrepIncreasing
            org.apache.hadoop.hdfs.server.namenode.TestTransferFsImage
            org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain
            org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery
            org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry
            org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement
            org.apache.hadoop.hdfs.TestAclsEndToEnd
            org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus
            org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
            org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            org.apache.hadoop.hdfs.TestFileCreation
            org.apache.hadoop.hdfs.TestQuota
            org.apache.hadoop.hdfs.server.namenode.TestStorageRestore
            org.apache.hadoop.hdfs.server.namenode.TestLeaseManager
            org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            org.apache.hadoop.hdfs.server.datanode.TestRefreshNamenodes
            org.apache.hadoop.hdfs.qjournal.server.TestJournalNode
            org.apache.hadoop.hdfs.TestReplication
            org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl
            org.apache.hadoop.hdfs.server.namenode.TestEditLog
            org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery
            org.apache.hadoop.hdfs.TestDatanodeDeath
            org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
            org.apache.hadoop.hdfs.server.datanode.TestTriggerBlockReport
            org.apache.hadoop.hdfs.TestPread
            org.apache.hadoop.hdfs.server.namenode.TestFSImage
            org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
            org.apache.hadoop.hdfs.server.datanode.TestLargeBlockReport
            org.apache.hadoop.hdfs.TestDFSStorageStateRecovery
            org.apache.hadoop.hdfs.TestDFSFinalize
            org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
            org.apache.hadoop.hdfs.TestFileAppend4
            org.apache.hadoop.hdfs.server.namenode.TestStreamFile
            org.apache.hadoop.hdfs.TestRead
            org.apache.hadoop.hdfs.TestDFSUpgradeFromImage
            org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage
            org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults
            org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr
            org.apache.hadoop.hdfs.TestDecommission
            org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean
            org.apache.hadoop.hdfs.server.datanode.TestBatchIbr
            org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
            org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
            org.apache.hadoop.hdfs.server.namenode.TestFileLimit
            org.apache.hadoop.hdfs.TestCrcCorruption
            org.apache.hadoop.hdfs.TestApplyingStoragePolicy
            org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
            org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
            org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
            org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
            org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
            org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
            org.apache.hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
            org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM
            org.apache.hadoop.hdfs.server.namenode.TestFileTruncate
            org.apache.hadoop.tracing.TestTracing
            org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
            org.apache.hadoop.tools.TestJMXGet
            org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode
            org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            org.apache.hadoop.hdfs.TestDFSOutputStream
            org.apache.hadoop.hdfs.server.mover.TestStorageMover
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
            org.apache.hadoop.hdfs.TestDFSMkdirs
            org.apache.hadoop.hdfs.TestHDFSServerPorts
            org.apache.hadoop.hdfs.TestLease
            org.apache.hadoop.hdfs.TestDFSUpgrade
            org.apache.hadoop.hdfs.server.balancer.TestBalancer
            org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite
            org.apache.hadoop.hdfs.web.TestWebHDFS
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
            org.apache.hadoop.hdfs.qjournal.TestNNWithQJM
            org.apache.hadoop.hdfs.tools.TestGetGroups
            org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
            org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean
            org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
            org.apache.hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy
            org.apache.hadoop.hdfs.TestRestartDFS
            org.apache.hadoop.hdfs.server.datanode.TestDiskError
            org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
            org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
            org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
            org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
            org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
            org.apache.hadoop.hdfs.TestRenameWhileOpen
            org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
            org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader
            org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
            org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache
            org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
            org.apache.hadoop.hdfs.TestDFSClientSocketSize
            org.apache.hadoop.hdfs.TestFSOutputSummer
            org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
            org.apache.hadoop.hdfs.server.namenode.TestXAttrConfigFlag
            org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
            org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
            org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
            org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
            org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
            org.apache.hadoop.hdfs.TestDFSRollback
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
            org.apache.hadoop.hdfs.TestMiniDFSCluster
            org.apache.hadoop.hdfs.server.namenode.TestAddBlock
            org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
            org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
            org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
            org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
            org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
            org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
            org.apache.hadoop.hdfs.server.datanode.TestBlockScanner
            org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController
            org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
            org.apache.hadoop.hdfs.TestTrashWithEncryptionZones
            org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
            org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
            org.apache.hadoop.hdfs.server.namenode.TestAuditLogs
            org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
            org.apache.hadoop.hdfs.server.namenode.TestHostsFiles
            org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll
            org.apache.hadoop.hdfs.server.namenode.TestProtectedDirectories
            org.apache.hadoop.fs.TestHDFSFileContextMainOperations
            org.apache.hadoop.hdfs.tools.TestDebugAdmin
            org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy
            org.apache.hadoop.fs.permission.TestStickyBit
            org.apache.hadoop.hdfs.TestDisableConnCache
            org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
            org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
            org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
            org.apache.hadoop.tracing.TestTraceAdmin
            org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            org.apache.hadoop.hdfs.TestHDFSTrash
            org.apache.hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
            org.apache.hadoop.tools.TestDistCpWithAcls
            org.apache.hadoop.tools.TestDistCpWithRawXAttrs
            org.apache.hadoop.tools.TestDistCpSync
            org.apache.hadoop.tools.TestDistCpWithXAttrs



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:c2d96dd
          JIRA Issue HADOOP-14866
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887245/HADOOP-14866.001.branch-2.8.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 3e5d4b16a94d 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2.8 / 584cd13
          Default Java 1.7.0_151
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-distcp.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-distcp U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 11m 30s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.       branch-2.8 Compile Tests 0 mvndep 0m 18s Maven dependency ordering for branch +1 mvninstall 10m 9s branch-2.8 passed +1 compile 8m 17s branch-2.8 passed +1 checkstyle 1m 22s branch-2.8 passed +1 mvnsite 1m 28s branch-2.8 passed +1 findbugs 2m 59s branch-2.8 passed +1 javadoc 1m 37s branch-2.8 passed       Patch Compile Tests 0 mvndep 0m 24s Maven dependency ordering for patch +1 mvninstall 1m 24s the patch passed +1 compile 8m 25s the patch passed +1 javac 8m 24s the patch passed +1 checkstyle 1m 17s root: The patch generated 0 new + 246 unchanged - 12 fixed = 246 total (was 258) +1 mvnsite 1m 28s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 16s the patch passed +1 javadoc 1m 33s the patch passed       Other Tests -1 unit 725m 26s hadoop-hdfs in the patch failed. -1 unit 106m 45s hadoop-distcp in the patch failed. -1 asflicense 14m 49s The patch generated 2 ASF License warnings. 930m 6s Reason Tests Failed junit tests hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.namenode.TestEditLogRace   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.TestDFSRename   hadoop.hdfs.TestDatanodeConfig   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength   hadoop.hdfs.TestDFSClientRetries   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.tools.TestDFSAdmin   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.namenode.TestMetaSave   hadoop.hdfs.TestLeaseRecovery   hadoop.hdfs.TestClientProtocolForPipelineRecovery   hadoop.hdfs.server.namenode.TestGenericJournalConf   hadoop.hdfs.TestWriteConfigurationToDFS   hadoop.hdfs.tools.TestStoragePolicyCommands   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.hdfs.TestPipelines   hadoop.hdfs.web.TestHftpFileSystem   hadoop.hdfs.TestFileCreationClient   hadoop.hdfs.TestParallelShortCircuitRead   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.hdfs.TestRollingUpgradeRollback   hadoop.hdfs.server.namenode.TestListOpenFiles   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.TestTrashWithSecureEncryptionZones   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.namenode.TestMalformedURLs   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.tools.TestDFSAdminWithHA   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.TestDataTransferKeepalive   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.TestExternalBlockReader   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.client.impl.TestBlockReaderLocal   hadoop.hdfs.TestSecureEncryptionZoneWithKMS   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.TestHdfsAdmin   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.web.TestWebHdfsTokens   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.hdfs.TestAbandonBlock   hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics   hadoop.hdfs.TestConnCache   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.TestFsShellPermission   hadoop.hdfs.TestExtendedAcls   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.TestRollingUpgradeDowngrade   hadoop.hdfs.client.impl.TestBlockReaderRemote   hadoop.hdfs.TestLocalDFS   hadoop.hdfs.server.namenode.TestGetBlockLocations   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.TestBlockMissingException   hadoop.hdfs.TestFileAppend3   hadoop.hdfs.TestFileStatus   hadoop.hdfs.server.namenode.TestINodeAttributeProvider   hadoop.hdfs.TestListFilesInDFS   hadoop.hdfs.TestFileLengthOnClusterRestart   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.hdfs.server.namenode.TestCreateEditsLog   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.web.TestWebHDFSXAttr   hadoop.hdfs.crypto.TestHdfsCryptoStreams   hadoop.hdfs.web.TestWebHDFSAcl   hadoop.hdfs.TestDataTransferProtocol   hadoop.hdfs.TestRollingUpgrade   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.hdfs.TestPersistBlocks   hadoop.hdfs.TestDFSAddressConfig   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   hadoop.hdfs.TestListPathServlet   hadoop.hdfs.web.TestWebHDFSForHA   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   hadoop.hdfs.TestDFSPermission   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting   hadoop.hdfs.TestDFSInotifyEventInputStream   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.TestFileAppend   hadoop.hdfs.TestDFSClientExcludedNodes   hadoop.hdfs.client.impl.TestClientBlockVerification   hadoop.hdfs.server.balancer.TestBalancerRPCDelay   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.TestParallelRead   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.TestReservedRawPaths   hadoop.hdfs.TestGetFileChecksum   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.TestEncryptionZonesWithHA   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   hadoop.hdfs.TestClientReportBadBlock   hadoop.hdfs.server.namenode.snapshot.TestSnapshotManager   hadoop.hdfs.TestHFlush   hadoop.hdfs.TestParallelUnixDomainRead   hadoop.hdfs.TestDatanodeReport   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens   hadoop.hdfs.TestDatanodeLayoutUpgrade   hadoop.hdfs.TestDFSShellGenericOptions   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.hdfs.TestFileAppendRestart   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes   hadoop.hdfs.server.namenode.TestSaveNamespace   hadoop.hdfs.server.namenode.TestNestedEncryptionZones   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.hdfs.client.impl.TestBlockReaderRemote2   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.shortcircuit.TestShortCircuitCache   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.TestReadWhileWriting   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.TestModTime   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.TestEncryptedTransfer   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.hdfs.server.mover.TestMover   hadoop.hdfs.util.TestDiff   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.hdfs.TestFetchImage   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.TestGetBlocks   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.client.impl.TestBlockReaderFactory   hadoop.hdfs.TestDataStream   hadoop.hdfs.TestSetrepDecreasing   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.hdfs.TestMissingBlocksAlert   hadoop.hdfs.security.token.block.TestBlockToken   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.TestDFSShell   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.hdfs.server.namenode.TestMetadataVersionOutput   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.TestHDFSFileSystemContract   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.hdfs.TestFileCreationEmpty   hadoop.hdfs.server.namenode.TestBackupNode   hadoop.hdfs.TestSafeMode   hadoop.hdfs.TestListFilesInFileContext   hadoop.hdfs.TestSeekBug   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl   hadoop.hdfs.TestLargeBlock   hadoop.hdfs.TestMultiThreadedHflush   hadoop.hdfs.web.TestFSMainOperationsWebHdfs   hadoop.hdfs.TestClose   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.TestSetTimes   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.tools.TestIntegration   hadoop.tools.TestDistCpSystem   hadoop.tools.util.TestThrottledInputStream   hadoop.tools.TestDistCpViewFs Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   org.apache.hadoop.hdfs.server.datanode.TestHSync   org.apache.hadoop.hdfs.server.namenode.TestStartup   org.apache.hadoop.hdfs.TestDFSStartupVersions   org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   org.apache.hadoop.hdfs.TestWriteRead   org.apache.hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool   org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   org.apache.hadoop.hdfs.TestDatanodeRegistration   org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager   org.apache.hadoop.hdfs.server.namenode.TestNameNodeHttpServer   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics   org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   org.apache.hadoop.hdfs.TestBlocksScheduledCounter   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl   org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics   org.apache.hadoop.hdfs.server.datanode.TestDataNodeExit   org.apache.hadoop.hdfs.TestDFSClientFailover   org.apache.hadoop.fs.TestEnhancedByteBufferAccess   org.apache.hadoop.hdfs.TestSetrepIncreasing   org.apache.hadoop.hdfs.server.namenode.TestTransferFsImage   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain   org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery   org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry   org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement   org.apache.hadoop.hdfs.TestAclsEndToEnd   org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus   org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   org.apache.hadoop.hdfs.TestFileCreation   org.apache.hadoop.hdfs.TestQuota   org.apache.hadoop.hdfs.server.namenode.TestStorageRestore   org.apache.hadoop.hdfs.server.namenode.TestLeaseManager   org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   org.apache.hadoop.hdfs.server.datanode.TestRefreshNamenodes   org.apache.hadoop.hdfs.qjournal.server.TestJournalNode   org.apache.hadoop.hdfs.TestReplication   org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl   org.apache.hadoop.hdfs.server.namenode.TestEditLog   org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery   org.apache.hadoop.hdfs.TestDatanodeDeath   org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   org.apache.hadoop.hdfs.server.datanode.TestTriggerBlockReport   org.apache.hadoop.hdfs.TestPread   org.apache.hadoop.hdfs.server.namenode.TestFSImage   org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark   org.apache.hadoop.hdfs.server.datanode.TestLargeBlockReport   org.apache.hadoop.hdfs.TestDFSStorageStateRecovery   org.apache.hadoop.hdfs.TestDFSFinalize   org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   org.apache.hadoop.hdfs.TestFileAppend4   org.apache.hadoop.hdfs.server.namenode.TestStreamFile   org.apache.hadoop.hdfs.TestRead   org.apache.hadoop.hdfs.TestDFSUpgradeFromImage   org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults   org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr   org.apache.hadoop.hdfs.TestDecommission   org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean   org.apache.hadoop.hdfs.server.datanode.TestBatchIbr   org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   org.apache.hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize   org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck   org.apache.hadoop.hdfs.server.namenode.TestFileLimit   org.apache.hadoop.hdfs.TestCrcCorruption   org.apache.hadoop.hdfs.TestApplyingStoragePolicy   org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer   org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing   org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   org.apache.hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM   org.apache.hadoop.hdfs.server.namenode.TestFileTruncate   org.apache.hadoop.tracing.TestTracing   org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   org.apache.hadoop.tools.TestJMXGet   org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode   org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   org.apache.hadoop.hdfs.TestDFSOutputStream   org.apache.hadoop.hdfs.server.mover.TestStorageMover   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   org.apache.hadoop.hdfs.TestDFSMkdirs   org.apache.hadoop.hdfs.TestHDFSServerPorts   org.apache.hadoop.hdfs.TestLease   org.apache.hadoop.hdfs.TestDFSUpgrade   org.apache.hadoop.hdfs.server.balancer.TestBalancer   org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite   org.apache.hadoop.hdfs.web.TestWebHDFS   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   org.apache.hadoop.hdfs.qjournal.TestNNWithQJM   org.apache.hadoop.hdfs.tools.TestGetGroups   org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster   org.apache.hadoop.hdfs.server.namenode.TestCheckpoint   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean   org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   org.apache.hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy   org.apache.hadoop.hdfs.TestRestartDFS   org.apache.hadoop.hdfs.server.datanode.TestDiskError   org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes   org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   org.apache.hadoop.hdfs.TestRenameWhileOpen   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader   org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache   org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead   org.apache.hadoop.hdfs.TestDFSClientSocketSize   org.apache.hadoop.hdfs.TestFSOutputSummer   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad   org.apache.hadoop.hdfs.server.namenode.TestXAttrConfigFlag   org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner   org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   org.apache.hadoop.hdfs.TestDFSRollback   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   org.apache.hadoop.hdfs.server.datanode.TestDataNodeReconfiguration   org.apache.hadoop.hdfs.TestMiniDFSCluster   org.apache.hadoop.hdfs.server.namenode.TestAddBlock   org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA   org.apache.hadoop.hdfs.server.datanode.TestBlockScanner   org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController   org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   org.apache.hadoop.hdfs.TestTrashWithEncryptionZones   org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   org.apache.hadoop.hdfs.server.namenode.TestAuditLogs   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   org.apache.hadoop.hdfs.server.namenode.TestHostsFiles   org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll   org.apache.hadoop.hdfs.server.namenode.TestProtectedDirectories   org.apache.hadoop.fs.TestHDFSFileContextMainOperations   org.apache.hadoop.hdfs.tools.TestDebugAdmin   org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy   org.apache.hadoop.fs.permission.TestStickyBit   org.apache.hadoop.hdfs.TestDisableConnCache   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode   org.apache.hadoop.tracing.TestTraceAdmin   org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   org.apache.hadoop.hdfs.TestHDFSTrash   org.apache.hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy   org.apache.hadoop.tools.TestDistCpWithAcls   org.apache.hadoop.tools.TestDistCpWithRawXAttrs   org.apache.hadoop.tools.TestDistCpSync   org.apache.hadoop.tools.TestDistCpWithXAttrs Subsystem Report/Notes Docker Image:yetus/hadoop:c2d96dd JIRA Issue HADOOP-14866 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887245/HADOOP-14866.001.branch-2.8.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 3e5d4b16a94d 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / 584cd13 Default Java 1.7.0_151 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-distcp.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/testReport/ asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-distcp U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/13291/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.

            People

            • Assignee:
              HuafengWang Huafeng Wang
              Reporter:
              HuafengWang Huafeng Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:

                Development