Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8035

Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There are functionality in FSNameSystem to check replication and to get datanode based on the client name. This jira proposes to move these functionality to BlockManager and DatanodeManager respectively.

      1. HDFS-8035.003.patch
        6 kB
        Haohui Mai
      2. HDFS-8035.002.patch
        11 kB
        Haohui Mai
      3. HDFS-8035.001.patch
        11 kB
        Haohui Mai
      4. HDFS-8035.000.patch
        11 kB
        Haohui Mai

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12708569/HDFS-8035.000.patch
        against trunk revision 2daa478.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestReplication
        org.apache.hadoop.hdfs.TestLeaseRecovery
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot
        org.apache.hadoop.hdfs.TestPread
        org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
        org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
        org.apache.hadoop.hdfs.TestSafeMode
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache
        org.apache.hadoop.hdfs.TestParallelShortCircuitRead
        org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader
        org.apache.hadoop.hdfs.TestFSInputChecker
        org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
        org.apache.hadoop.hdfs.tools.TestDebugAdmin
        org.apache.hadoop.hdfs.TestSetrepIncreasing
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
        org.apache.hadoop.fs.TestEnhancedByteBufferAccess
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
        org.apache.hadoop.hdfs.TestMultiThreadedHflush
        org.apache.hadoop.hdfs.TestParallelRead
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
        org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
        org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands
        org.apache.hadoop.hdfs.TestDFSRemove
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
        org.apache.hadoop.hdfs.TestHFlush
        org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
        org.apache.hadoop.hdfs.TestSetTimes
        org.apache.hadoop.hdfs.server.namenode.TestAddBlock
        org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
        org.apache.hadoop.hdfs.TestMissingBlocksAlert
        org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
        org.apache.hadoop.hdfs.TestBlocksScheduledCounter
        org.apache.hadoop.hdfs.TestEncryptedTransfer
        org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
        org.apache.hadoop.hdfs.server.mover.TestMover
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
        org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
        org.apache.hadoop.fs.TestUnbuffer
        org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead
        org.apache.hadoop.hdfs.TestQuota
        org.apache.hadoop.hdfs.TestDFSClientFailover
        org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache
        org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
        org.apache.hadoop.hdfs.TestDFSClientRetries
        org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes
        org.apache.hadoop.hdfs.server.namenode.TestFSImage
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
        org.apache.hadoop.tracing.TestTracing
        org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
        org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
        org.apache.hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
        org.apache.hadoop.hdfs.TestReadWhileWriting
        org.apache.hadoop.hdfs.TestClientBlockVerification
        org.apache.hadoop.hdfs.TestDataTransferProtocol
        org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
        org.apache.hadoop.hdfs.server.namenode.TestAuditLogs
        org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
        org.apache.hadoop.hdfs.web.TestWebHDFS
        org.apache.hadoop.fs.TestFcHdfsPermission
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
        org.apache.hadoop.hdfs.TestDecommission
        org.apache.hadoop.hdfs.server.namenode.TestFSDirectory
        org.apache.hadoop.hdfs.TestFileAppend
        org.apache.hadoop.hdfs.server.datanode.TestTriggerBlockReport
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
        org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
        org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart
        org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
        org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite
        org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
        org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
        org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
        org.apache.hadoop.hdfs.TestGetBlocks
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek
        org.apache.hadoop.hdfs.server.namenode.TestDeleteRace
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
        org.apache.hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
        org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
        org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations
        org.apache.hadoop.fs.permission.TestStickyBit
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager
        org.apache.hadoop.fs.TestGlobPaths
        org.apache.hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
        org.apache.hadoop.fs.TestFcHdfsCreateMkdir
        org.apache.hadoop.hdfs.TestParallelUnixDomainRead
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
        org.apache.hadoop.hdfs.server.balancer.TestBalancer
        org.apache.hadoop.hdfs.TestDFSRename
        org.apache.hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
        org.apache.hadoop.hdfs.TestFSOutputSummer
        org.apache.hadoop.hdfs.TestConnCache
        org.apache.hadoop.hdfs.TestDFSMkdirs
        org.apache.hadoop.hdfs.TestWriteRead
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
        org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
        org.apache.hadoop.hdfs.TestEncryptionZonesWithHA
        org.apache.hadoop.hdfs.server.namenode.TestEditLog
        org.apache.hadoop.hdfs.server.datanode.TestDiskError
        org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives
        org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
        org.apache.hadoop.hdfs.server.namenode.TestFileTruncate
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen
        org.apache.hadoop.hdfs.TestBlockReaderFactory
        org.apache.hadoop.hdfs.server.namenode.TestINodeFile
        org.apache.hadoop.hdfs.TestSetrepDecreasing
        org.apache.hadoop.hdfs.TestDFSFinalize
        org.apache.hadoop.fs.TestFcHdfsSetUMask
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
        org.apache.hadoop.hdfs.TestLargeBlock
        org.apache.hadoop.fs.TestUrlStreamHandler
        org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
        org.apache.hadoop.hdfs.TestDisableConnCache
        org.apache.hadoop.hdfs.TestLease
        org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
        org.apache.hadoop.hdfs.web.TestHttpsFileSystem
        org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
        org.apache.hadoop.hdfs.TestHDFSTrash
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
        org.apache.hadoop.hdfs.TestDistributedFileSystem
        org.apache.hadoop.tools.TestJMXGet
        org.apache.hadoop.hdfs.TestFileCreation
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
        org.apache.hadoop.hdfs.TestDataTransferKeepalive
        org.apache.hadoop.fs.TestSymlinkHdfsFileSystem
        org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs
        org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
        org.apache.hadoop.hdfs.server.datanode.TestBlockScanner
        org.apache.hadoop.hdfs.server.mover.TestStorageMover
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
        org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
        org.apache.hadoop.fs.viewfs.TestViewFsHdfs
        org.apache.hadoop.hdfs.web.TestWebHDFSForHA
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
        org.apache.hadoop.hdfs.TestBlockMissingException
        org.apache.hadoop.hdfs.server.namenode.TestTruncateQuotaUpdate
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
        org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery
        org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
        org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
        org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool
        org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
        org.apache.hadoop.hdfs.TestSmallBlock
        org.apache.hadoop.hdfs.TestPipelines
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
        org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl
        org.apache.hadoop.hdfs.TestRenameWhileOpen
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr
        org.apache.hadoop.hdfs.TestRollingUpgrade
        org.apache.hadoop.hdfs.TestEncryptionZones
        org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir
        org.apache.hadoop.hdfs.TestFileAppend3
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate
        org.apache.hadoop.hdfs.TestLocalDFS
        org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs
        org.apache.hadoop.fs.TestSymlinkHdfsDisable
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
        org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
        org.apache.hadoop.hdfs.TestSeekBug
        org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached
        org.apache.hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
        org.apache.hadoop.fs.TestHDFSFileContextMainOperations
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend
        org.apache.hadoop.fs.TestSymlinkHdfsFileContext
        org.apache.hadoop.hdfs.server.namenode.TestBackupNode
        org.apache.hadoop.hdfs.TestBlockReaderLocal
        org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue
        org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
        org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        org.apache.hadoop.hdfs.TestListFilesInFileContext
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
        org.apache.hadoop.hdfs.TestModTime
        org.apache.hadoop.hdfs.web.TestWebHDFSXAttr
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation
        org.apache.hadoop.hdfs.security.TestDelegationToken
        org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy
        org.apache.hadoop.hdfs.server.namenode.TestFileLimit
        org.apache.hadoop.hdfs.server.namenode.TestFsck
        org.apache.hadoop.hdfs.TestClose
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
        org.apache.hadoop.hdfs.server.datanode.TestHSync
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename
        org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
        org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl
        org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType
        org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
        org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement
        org.apache.hadoop.hdfs.TestWriteConfigurationToDFS
        org.apache.hadoop.hdfs.TestFileStatus
        org.apache.hadoop.hdfs.TestFsShellPermission
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
        org.apache.hadoop.hdfs.server.namenode.TestMetaSave
        org.apache.hadoop.fs.loadGenerator.TestLoadGenerator
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
        org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage
        org.apache.hadoop.hdfs.server.namenode.TestStartup
        org.apache.hadoop.hdfs.server.datanode.TestTransferRbw
        org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs
        org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry
        org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
        org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
        org.apache.hadoop.hdfs.server.namenode.TestHostsFiles
        org.apache.hadoop.fs.shell.TestHdfsTextCommand
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication
        org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate

        The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestPersistBlocks
        org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
        org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10135//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10135//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12708569/HDFS-8035.000.patch against trunk revision 2daa478. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestReplication org.apache.hadoop.hdfs.TestLeaseRecovery org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot org.apache.hadoop.hdfs.TestPread org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength org.apache.hadoop.hdfs.TestSafeMode org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache org.apache.hadoop.hdfs.TestParallelShortCircuitRead org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader org.apache.hadoop.hdfs.TestFSInputChecker org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks org.apache.hadoop.hdfs.tools.TestDebugAdmin org.apache.hadoop.hdfs.TestSetrepIncreasing org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles org.apache.hadoop.fs.TestEnhancedByteBufferAccess org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup org.apache.hadoop.hdfs.TestMultiThreadedHflush org.apache.hadoop.hdfs.TestParallelRead org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands org.apache.hadoop.hdfs.TestDFSRemove org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot org.apache.hadoop.hdfs.TestHFlush org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics org.apache.hadoop.hdfs.TestSetTimes org.apache.hadoop.hdfs.server.namenode.TestAddBlock org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold org.apache.hadoop.hdfs.TestMissingBlocksAlert org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum org.apache.hadoop.hdfs.TestBlocksScheduledCounter org.apache.hadoop.hdfs.TestEncryptedTransfer org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs org.apache.hadoop.hdfs.server.mover.TestMover org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode org.apache.hadoop.fs.TestUnbuffer org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead org.apache.hadoop.hdfs.TestQuota org.apache.hadoop.hdfs.TestDFSClientFailover org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA org.apache.hadoop.hdfs.TestDFSClientRetries org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes org.apache.hadoop.hdfs.server.namenode.TestFSImage org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl org.apache.hadoop.tracing.TestTracing org.apache.hadoop.hdfs.server.namenode.TestCheckpoint org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory org.apache.hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing org.apache.hadoop.hdfs.TestReadWhileWriting org.apache.hadoop.hdfs.TestClientBlockVerification org.apache.hadoop.hdfs.TestDataTransferProtocol org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport org.apache.hadoop.hdfs.server.namenode.TestAuditLogs org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract org.apache.hadoop.hdfs.web.TestWebHDFS org.apache.hadoop.fs.TestFcHdfsPermission org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart org.apache.hadoop.hdfs.TestDecommission org.apache.hadoop.hdfs.server.namenode.TestFSDirectory org.apache.hadoop.hdfs.TestFileAppend org.apache.hadoop.hdfs.server.datanode.TestTriggerBlockReport org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover org.apache.hadoop.hdfs.TestGetBlocks org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek org.apache.hadoop.hdfs.server.namenode.TestDeleteRace org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication org.apache.hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations org.apache.hadoop.fs.permission.TestStickyBit org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager org.apache.hadoop.fs.TestGlobPaths org.apache.hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork org.apache.hadoop.fs.TestFcHdfsCreateMkdir org.apache.hadoop.hdfs.TestParallelUnixDomainRead org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer org.apache.hadoop.hdfs.server.balancer.TestBalancer org.apache.hadoop.hdfs.TestDFSRename org.apache.hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration org.apache.hadoop.hdfs.TestFSOutputSummer org.apache.hadoop.hdfs.TestConnCache org.apache.hadoop.hdfs.TestDFSMkdirs org.apache.hadoop.hdfs.TestWriteRead org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA org.apache.hadoop.hdfs.TestEncryptionZonesWithHA org.apache.hadoop.hdfs.server.namenode.TestEditLog org.apache.hadoop.hdfs.server.datanode.TestDiskError org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality org.apache.hadoop.hdfs.server.namenode.TestFileTruncate org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen org.apache.hadoop.hdfs.TestBlockReaderFactory org.apache.hadoop.hdfs.server.namenode.TestINodeFile org.apache.hadoop.hdfs.TestSetrepDecreasing org.apache.hadoop.hdfs.TestDFSFinalize org.apache.hadoop.fs.TestFcHdfsSetUMask org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot org.apache.hadoop.hdfs.TestLargeBlock org.apache.hadoop.fs.TestUrlStreamHandler org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport org.apache.hadoop.hdfs.TestDisableConnCache org.apache.hadoop.hdfs.TestLease org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement org.apache.hadoop.hdfs.web.TestHttpsFileSystem org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps org.apache.hadoop.hdfs.TestHDFSTrash org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes org.apache.hadoop.hdfs.TestDistributedFileSystem org.apache.hadoop.tools.TestJMXGet org.apache.hadoop.hdfs.TestFileCreation org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage org.apache.hadoop.hdfs.TestDataTransferKeepalive org.apache.hadoop.fs.TestSymlinkHdfsFileSystem org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles org.apache.hadoop.hdfs.server.datanode.TestBlockScanner org.apache.hadoop.hdfs.server.mover.TestStorageMover org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints org.apache.hadoop.fs.viewfs.TestViewFsHdfs org.apache.hadoop.hdfs.web.TestWebHDFSForHA org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap org.apache.hadoop.hdfs.TestBlockMissingException org.apache.hadoop.hdfs.server.namenode.TestTruncateQuotaUpdate org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy org.apache.hadoop.hdfs.TestSmallBlock org.apache.hadoop.hdfs.TestPipelines org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl org.apache.hadoop.hdfs.TestRenameWhileOpen org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr org.apache.hadoop.hdfs.TestRollingUpgrade org.apache.hadoop.hdfs.TestEncryptionZones org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir org.apache.hadoop.hdfs.TestFileAppend3 org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate org.apache.hadoop.hdfs.TestLocalDFS org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs org.apache.hadoop.fs.TestSymlinkHdfsDisable org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer org.apache.hadoop.hdfs.TestSeekBug org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached org.apache.hadoop.hdfs.server.blockmanagement.TestSequentialBlockId org.apache.hadoop.fs.TestHDFSFileContextMainOperations org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend org.apache.hadoop.fs.TestSymlinkHdfsFileContext org.apache.hadoop.hdfs.server.namenode.TestBackupNode org.apache.hadoop.hdfs.TestBlockReaderLocal org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA org.apache.hadoop.hdfs.TestListFilesInFileContext org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure org.apache.hadoop.hdfs.TestModTime org.apache.hadoop.hdfs.web.TestWebHDFSXAttr org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation org.apache.hadoop.hdfs.security.TestDelegationToken org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy org.apache.hadoop.hdfs.server.namenode.TestFileLimit org.apache.hadoop.hdfs.server.namenode.TestFsck org.apache.hadoop.hdfs.TestClose org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks org.apache.hadoop.hdfs.server.datanode.TestHSync org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement org.apache.hadoop.hdfs.TestWriteConfigurationToDFS org.apache.hadoop.hdfs.TestFileStatus org.apache.hadoop.hdfs.TestFsShellPermission org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication org.apache.hadoop.hdfs.server.namenode.TestMetaSave org.apache.hadoop.fs.loadGenerator.TestLoadGenerator org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage org.apache.hadoop.hdfs.server.namenode.TestStartup org.apache.hadoop.hdfs.server.datanode.TestTransferRbw org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled org.apache.hadoop.hdfs.server.namenode.TestHostsFiles org.apache.hadoop.fs.shell.TestHdfsTextCommand org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestPersistBlocks org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10135//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10135//console This message is automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12708603/HDFS-8035.001.patch
        against trunk revision 2daa478.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10138//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10138//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12708603/HDFS-8035.001.patch against trunk revision 2daa478. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10138//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10138//console This message is automatically generated.
        Hide
        jingzhao Jing Zhao added a comment -

        The patch looks good to me. One comment is that now the patch moves getDatanodeByHost out of the read lock, thus reading host2DatanodeMap is no longer lock protected.

        Show
        jingzhao Jing Zhao added a comment - The patch looks good to me. One comment is that now the patch moves getDatanodeByHost out of the read lock, thus reading host2DatanodeMap is no longer lock protected.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12708753/HDFS-8035.002.patch
        against trunk revision 796fb26.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10144//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10144//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12708753/HDFS-8035.002.patch against trunk revision 796fb26. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10144//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10144//console This message is automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12708870/HDFS-8035.003.patch
        against trunk revision f383fd9.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestLeaseRecovery2

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10159//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10159//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12708870/HDFS-8035.003.patch against trunk revision f383fd9. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestLeaseRecovery2 Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10159//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10159//console This message is automatically generated.
        Hide
        jingzhao Jing Zhao added a comment -

        +1 for the latest patch. You may need to update the jira title and description accordingly.

        Show
        jingzhao Jing Zhao added a comment - +1 for the latest patch. You may need to update the jira title and description accordingly.
        Hide
        wheat9 Haohui Mai added a comment -

        I've committed the patch to trunk and branch-2. Thanks Jing for the reviews.

        Show
        wheat9 Haohui Mai added a comment - I've committed the patch to trunk and branch-2. Thanks Jing for the reviews.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7495 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7495/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7495 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7495/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/152/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/152/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/886/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/886/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/143/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/143/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2084/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2084/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/153/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/153/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2102/)
        HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2102/ ) HDFS-8035 . Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. (wheat9: rev 96649c38f9ab00a9845d2c6e35e6264894da5309) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

          People

          • Assignee:
            wheat9 Haohui Mai
            Reporter:
            wheat9 Haohui Mai
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development