Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11049

The description of dfs.block.replicator.classname is not clear

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Now the description of the property dfs.block.replicator.classname seems not clearly. The current description:

      <property>
        <name>dfs.block.replicator.classname</name>  <value>org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault</value>
        <description>
          Class representing block placement policy for non-striped files.
        </description>
      </property>
      

      It seems too simple and the users will not get the other available block placement policies and its usage. For example in HDFS-7541, it introduced a new policy BlockPlacementPolicyWithUpgradeDomain. This policy can be good used in rolling upgrade opeations.

      In addition, I don't find other documentations that concretely introducing the existing placement policies. This JIRA foucus on making a improvement for this in file hdfs-default.xml.

      1. HDFS-11049.002.patch
        1 kB
        Yiqun Lin
      2. HDFS-11049.001.patch
        1 kB
        Yiqun Lin

        Activity

        Hide
        linyiqun Yiqun Lin added a comment -

        Thanks Akira Ajisaka for the commit!

        Show
        linyiqun Yiqun Lin added a comment - Thanks Akira Ajisaka for the commit!
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10698 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10698/)
        HDFS-11049. The description of dfs.block.replicator.classname is not (aajisaka: rev 9c680d0b0508934b9b000ece84f25988272e901f)

        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10698 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10698/ ) HDFS-11049 . The description of dfs.block.replicator.classname is not (aajisaka: rev 9c680d0b0508934b9b000ece84f25988272e901f) (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Committed this to trunk and branch-2. Thanks Yiqun Lin for the contribution!

        Show
        ajisakaa Akira Ajisaka added a comment - Committed this to trunk and branch-2. Thanks Yiqun Lin for the contribution!
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1, checking this in.

        Show
        ajisakaa Akira Ajisaka added a comment - +1, checking this in.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 8m 16s trunk passed
        +1 compile 0m 52s trunk passed
        +1 mvnsite 1m 2s trunk passed
        +1 mvneclipse 0m 15s trunk passed
        +1 javadoc 0m 43s trunk passed
        +1 mvninstall 0m 55s the patch passed
        +1 compile 0m 57s the patch passed
        +1 javac 0m 57s the patch passed
        +1 mvnsite 1m 1s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 javadoc 0m 40s the patch passed
        -1 unit 53m 44s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 19s The patch does not generate ASF License warnings.
        70m 16s



        Reason Tests
        Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
          org.apache.hadoop.hdfs.server.namenode.TestINodeFile
          org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail
          org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HDFS-11049
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835101/HDFS-11049.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
        uname Linux 3d514c082d3f 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 9f32364
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/17311/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17311/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17311/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 8m 16s trunk passed +1 compile 0m 52s trunk passed +1 mvnsite 1m 2s trunk passed +1 mvneclipse 0m 15s trunk passed +1 javadoc 0m 43s trunk passed +1 mvninstall 0m 55s the patch passed +1 compile 0m 57s the patch passed +1 javac 0m 57s the patch passed +1 mvnsite 1m 1s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 javadoc 0m 40s the patch passed -1 unit 53m 44s hadoop-hdfs in the patch failed. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 70m 16s Reason Tests Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   org.apache.hadoop.hdfs.server.namenode.TestINodeFile   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HDFS-11049 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835101/HDFS-11049.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux 3d514c082d3f 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 9f32364 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HDFS-Build/17311/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17311/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17311/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 21s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 8m 4s trunk passed
        +1 compile 0m 48s trunk passed
        +1 mvnsite 0m 56s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        +1 javadoc 0m 39s trunk passed
        +1 mvninstall 0m 48s the patch passed
        +1 compile 0m 46s the patch passed
        +1 javac 0m 46s the patch passed
        +1 mvnsite 0m 52s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 javadoc 0m 41s the patch passed
        -1 unit 47m 30s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 24s The patch does not generate ASF License warnings.
        63m 34s



        Reason Tests
        Timed out junit tests org.apache.hadoop.hdfs.TestEncryptionZones
          org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend
          org.apache.hadoop.hdfs.server.datanode.TestHSync
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
          org.apache.hadoop.hdfs.TestLeaseRecovery2
          org.apache.hadoop.hdfs.TestFileChecksum
          org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead
          org.apache.hadoop.hdfs.TestLargeBlock
          org.apache.hadoop.hdfs.server.namenode.TestStartup
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
          org.apache.hadoop.hdfs.TestDFSStartupVersions
          org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA
          org.apache.hadoop.hdfs.TestWriteRead
          org.apache.hadoop.hdfs.TestParallelShortCircuitRead
          org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs
          org.apache.hadoop.hdfs.server.blockmanagement.TestDatanodeManager
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
          org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool
          org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager
          org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
          org.apache.hadoop.hdfs.TestParallelRead
          org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager
          org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
          org.apache.hadoop.fs.TestSymlinkHdfsFileContext
          org.apache.hadoop.hdfs.TestMaintenanceState
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
          org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl
          org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
          org.apache.hadoop.fs.TestEnhancedByteBufferAccess
          org.apache.hadoop.hdfs.TestMultiThreadedHflush
          org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
          org.apache.hadoop.hdfs.TestReservedRawPaths
          org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery
          org.apache.hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170
          org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure
          org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery
          org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement
          org.apache.hadoop.hdfs.TestAclsEndToEnd
          org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
          org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus
          org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
          org.apache.hadoop.hdfs.TestFileCreation
          org.apache.hadoop.hdfs.qjournal.server.TestJournalNode
          org.apache.hadoop.hdfs.TestQuota
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
          org.apache.hadoop.hdfs.server.namenode.TestStorageRestore
          org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
          org.apache.hadoop.hdfs.TestDataTransferKeepalive
          org.apache.hadoop.hdfs.TestReplication
          org.apache.hadoop.hdfs.server.namenode.TestINodeFile
          org.apache.hadoop.hdfs.server.namenode.TestEditLog
          org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
          org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover
          org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130
          org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
          org.apache.hadoop.hdfs.TestReconstructStripedFile
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
          org.apache.hadoop.hdfs.TestFileAppend
          org.apache.hadoop.hdfs.TestPread
          org.apache.hadoop.hdfs.TestSafeMode
          org.apache.hadoop.hdfs.server.namenode.TestBackupNode
          org.apache.hadoop.hdfs.server.namenode.TestFSImage
          org.apache.hadoop.hdfs.server.datanode.TestLargeBlockReport
          org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType
          org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
          org.apache.hadoop.hdfs.TestDFSStorageStateRecovery
          org.apache.hadoop.hdfs.TestFileAppend4
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
          org.apache.hadoop.hdfs.TestFileAppend3
          org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults
          org.apache.hadoop.hdfs.TestFileAppend2
          org.apache.hadoop.hdfs.TestDFSUpgradeFromImage
          org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage
          org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
          org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr
          org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr
          org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives
          org.apache.hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
          org.apache.hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
          org.apache.hadoop.hdfs.server.datanode.TestBatchIbr
          org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
          org.apache.hadoop.hdfs.TestErasureCodingPolicies
          org.apache.hadoop.hdfs.TestFileCorruption
          org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
          org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
          org.apache.hadoop.hdfs.TestFileCreationDelete
          org.apache.hadoop.hdfs.TestDFSStripedOutputStream
          org.apache.hadoop.hdfs.client.impl.TestBlockReaderLocal
          org.apache.hadoop.hdfs.TestCrcCorruption
          org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
          org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
          org.apache.hadoop.hdfs.server.namenode.TestFsck
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancer
          org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
          org.apache.hadoop.hdfs.TestDFSStripedInputStream
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
          org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
          org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
          org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM
          org.apache.hadoop.hdfs.TestBlockStoragePolicy
          org.apache.hadoop.hdfs.TestLeaseRecovery
          org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
          org.apache.hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
          org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
          org.apache.hadoop.hdfs.TestDFSRemove
          org.apache.hadoop.hdfs.TestRollingUpgrade
          org.apache.hadoop.hdfs.server.namenode.TestFileTruncate
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
          org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
          org.apache.hadoop.hdfs.server.namenode.TestEditLogJournalFailures
          org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
          org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
          org.apache.hadoop.hdfs.server.mover.TestStorageMover
          org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
          org.apache.hadoop.hdfs.TestDFSInputStream
          org.apache.hadoop.hdfs.TestDFSUpgrade
          org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite
          org.apache.hadoop.hdfs.server.balancer.TestBalancer
          org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding
          org.apache.hadoop.hdfs.server.namenode.TestMetaSave
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
          org.apache.hadoop.hdfs.TestAppendSnapshotTruncate
          org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks
          org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
          org.apache.hadoop.hdfs.server.namenode.TestAddStripedBlocks
          org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean
          org.apache.hadoop.hdfs.TestDataStream
          org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
          org.apache.hadoop.hdfs.client.impl.TestBlockReaderFactory
          org.apache.hadoop.hdfs.TestRestartDFS
          org.apache.hadoop.hdfs.server.mover.TestMover
          org.apache.hadoop.hdfs.server.datanode.TestDiskError
          org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache
          org.apache.hadoop.hdfs.server.namenode.TestNestedEncryptionZones
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
          org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
          org.apache.hadoop.hdfs.server.namenode.TestFSDirectory
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060
          org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC
          org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams
          org.apache.hadoop.hdfs.TestRenameWhileOpen
          org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
          org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader
          org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
          org.apache.hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
          org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
          org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations
          org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache
          org.apache.hadoop.hdfs.TestFileConcurrentReader
          org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReconstruction
          org.apache.hadoop.hdfs.server.datanode.TestBPOfferService
          org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
          org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl
          org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020
          org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
          org.apache.hadoop.hdfs.server.namenode.TestDeleteRace
          org.apache.hadoop.hdfs.server.namenode.TestAclConfigFlag
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
          org.apache.hadoop.hdfs.TestDecommissionWithStriped
          org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail
          org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
          org.apache.hadoop.hdfs.server.namenode.TestAddBlock
          org.apache.hadoop.hdfs.server.namenode.TestEditLogRace
          org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
          org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
          org.apache.hadoop.hdfs.server.datanode.TestBlockScanner
          org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController
          org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations
          org.apache.hadoop.hdfs.TestHFlush
          org.apache.hadoop.hdfs.TestLeaseRecoveryStriped
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          org.apache.hadoop.fs.TestSymlinkHdfsFileSystem
          org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached
          org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
          org.apache.hadoop.hdfs.TestEncryptedTransfer
          org.apache.hadoop.hdfs.server.namenode.TestAuditLogs
          org.apache.hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
          org.apache.hadoop.hdfs.TestPersistBlocks
          org.apache.hadoop.hdfs.server.namenode.TestAuditLogger
          org.apache.hadoop.hdfs.server.namenode.TestHostsFiles
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics
          org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek
          org.apache.hadoop.hdfs.server.namenode.TestProtectedDirectories
          org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
          org.apache.hadoop.hdfs.tools.TestDFSAdmin
          org.apache.hadoop.hdfs.TestGetBlocks
          org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
          org.apache.hadoop.hdfs.TestParallelUnixDomainRead
          org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
          org.apache.hadoop.cli.TestHDFSCLI



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HDFS-11049
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835101/HDFS-11049.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
        uname Linux b1735ed036b5 3.13.0-96-generic #143-Ubuntu SMP Mon Aug 29 20:15:20 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / dbd2057
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/17272/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17272/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17272/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 8m 4s trunk passed +1 compile 0m 48s trunk passed +1 mvnsite 0m 56s trunk passed +1 mvneclipse 0m 14s trunk passed +1 javadoc 0m 39s trunk passed +1 mvninstall 0m 48s the patch passed +1 compile 0m 46s the patch passed +1 javac 0m 46s the patch passed +1 mvnsite 0m 52s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 javadoc 0m 41s the patch passed -1 unit 47m 30s hadoop-hdfs in the patch failed. +1 asflicense 0m 24s The patch does not generate ASF License warnings. 63m 34s Reason Tests Timed out junit tests org.apache.hadoop.hdfs.TestEncryptionZones   org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend   org.apache.hadoop.hdfs.server.datanode.TestHSync   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   org.apache.hadoop.hdfs.TestLeaseRecovery2   org.apache.hadoop.hdfs.TestFileChecksum   org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead   org.apache.hadoop.hdfs.TestLargeBlock   org.apache.hadoop.hdfs.server.namenode.TestStartup   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   org.apache.hadoop.hdfs.TestDFSStartupVersions   org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA   org.apache.hadoop.hdfs.TestWriteRead   org.apache.hadoop.hdfs.TestParallelShortCircuitRead   org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs   org.apache.hadoop.hdfs.server.blockmanagement.TestDatanodeManager   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool   org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager   org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   org.apache.hadoop.hdfs.TestParallelRead   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager   org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   org.apache.hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics   org.apache.hadoop.fs.TestSymlinkHdfsFileContext   org.apache.hadoop.hdfs.TestMaintenanceState   org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   org.apache.hadoop.fs.TestEnhancedByteBufferAccess   org.apache.hadoop.hdfs.TestMultiThreadedHflush   org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   org.apache.hadoop.hdfs.TestReservedRawPaths   org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery   org.apache.hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170   org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure   org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery   org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement   org.apache.hadoop.hdfs.TestAclsEndToEnd   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus   org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   org.apache.hadoop.hdfs.TestFileCreation   org.apache.hadoop.hdfs.qjournal.server.TestJournalNode   org.apache.hadoop.hdfs.TestQuota   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   org.apache.hadoop.hdfs.server.namenode.TestStorageRestore   org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   org.apache.hadoop.hdfs.TestDataTransferKeepalive   org.apache.hadoop.hdfs.TestReplication   org.apache.hadoop.hdfs.server.namenode.TestINodeFile   org.apache.hadoop.hdfs.server.namenode.TestEditLog   org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl   org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover   org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130   org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer   org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace   org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   org.apache.hadoop.hdfs.TestReconstructStripedFile   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   org.apache.hadoop.hdfs.TestFileAppend   org.apache.hadoop.hdfs.TestPread   org.apache.hadoop.hdfs.TestSafeMode   org.apache.hadoop.hdfs.server.namenode.TestBackupNode   org.apache.hadoop.hdfs.server.namenode.TestFSImage   org.apache.hadoop.hdfs.server.datanode.TestLargeBlockReport   org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType   org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   org.apache.hadoop.hdfs.TestDFSStorageStateRecovery   org.apache.hadoop.hdfs.TestFileAppend4   org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   org.apache.hadoop.hdfs.TestFileAppend3   org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults   org.apache.hadoop.hdfs.TestFileAppend2   org.apache.hadoop.hdfs.TestDFSUpgradeFromImage   org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr   org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr   org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives   org.apache.hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks   org.apache.hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand   org.apache.hadoop.hdfs.server.datanode.TestBatchIbr   org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   org.apache.hadoop.hdfs.TestErasureCodingPolicies   org.apache.hadoop.hdfs.TestFileCorruption   org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr   org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   org.apache.hadoop.hdfs.TestFileCreationDelete   org.apache.hadoop.hdfs.TestDFSStripedOutputStream   org.apache.hadoop.hdfs.client.impl.TestBlockReaderLocal   org.apache.hadoop.hdfs.TestCrcCorruption   org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing   org.apache.hadoop.hdfs.server.namenode.TestFsck   org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot   org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancer   org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped   org.apache.hadoop.hdfs.TestDFSStripedInputStream   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS   org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM   org.apache.hadoop.hdfs.TestBlockStoragePolicy   org.apache.hadoop.hdfs.TestLeaseRecovery   org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   org.apache.hadoop.hdfs.server.namenode.TestReconstructStripedBlocks   org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   org.apache.hadoop.hdfs.TestDFSRemove   org.apache.hadoop.hdfs.TestRollingUpgrade   org.apache.hadoop.hdfs.server.namenode.TestFileTruncate   org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   org.apache.hadoop.hdfs.server.namenode.TestEditLogJournalFailures   org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   org.apache.hadoop.hdfs.server.mover.TestStorageMover   org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   org.apache.hadoop.hdfs.TestDFSInputStream   org.apache.hadoop.hdfs.TestDFSUpgrade   org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite   org.apache.hadoop.hdfs.server.balancer.TestBalancer   org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding   org.apache.hadoop.hdfs.server.namenode.TestMetaSave   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   org.apache.hadoop.hdfs.TestAppendSnapshotTruncate   org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks   org.apache.hadoop.hdfs.server.namenode.TestCheckpoint   org.apache.hadoop.hdfs.server.namenode.TestAddStripedBlocks   org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean   org.apache.hadoop.hdfs.TestDataStream   org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs   org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   org.apache.hadoop.hdfs.client.impl.TestBlockReaderFactory   org.apache.hadoop.hdfs.TestRestartDFS   org.apache.hadoop.hdfs.server.mover.TestMover   org.apache.hadoop.hdfs.server.datanode.TestDiskError   org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache   org.apache.hadoop.hdfs.server.namenode.TestNestedEncryptionZones   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   org.apache.hadoop.hdfs.server.namenode.TestFSDirectory   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060   org.apache.hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC   org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams   org.apache.hadoop.hdfs.TestRenameWhileOpen   org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader   org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   org.apache.hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness   org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache   org.apache.hadoop.hdfs.TestFileConcurrentReader   org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReconstruction   org.apache.hadoop.hdfs.server.datanode.TestBPOfferService   org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl   org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020   org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   org.apache.hadoop.hdfs.server.namenode.TestDeleteRace   org.apache.hadoop.hdfs.server.namenode.TestAclConfigFlag   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   org.apache.hadoop.hdfs.server.datanode.TestDataNodeReconfiguration   org.apache.hadoop.hdfs.TestDecommissionWithStriped   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail   org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   org.apache.hadoop.hdfs.server.namenode.TestAddBlock   org.apache.hadoop.hdfs.server.namenode.TestEditLogRace   org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   org.apache.hadoop.hdfs.server.datanode.TestBlockScanner   org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController   org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations   org.apache.hadoop.hdfs.TestHFlush   org.apache.hadoop.hdfs.TestLeaseRecoveryStriped   org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   org.apache.hadoop.fs.TestSymlinkHdfsFileSystem   org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached   org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   org.apache.hadoop.hdfs.TestEncryptedTransfer   org.apache.hadoop.hdfs.server.namenode.TestAuditLogs   org.apache.hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   org.apache.hadoop.hdfs.TestPersistBlocks   org.apache.hadoop.hdfs.server.namenode.TestAuditLogger   org.apache.hadoop.hdfs.server.namenode.TestHostsFiles   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   org.apache.hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics   org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek   org.apache.hadoop.hdfs.server.namenode.TestProtectedDirectories   org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   org.apache.hadoop.hdfs.tools.TestDFSAdmin   org.apache.hadoop.hdfs.TestGetBlocks   org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode   org.apache.hadoop.hdfs.TestParallelUnixDomainRead   org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   org.apache.hadoop.cli.TestHDFSCLI Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HDFS-11049 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835101/HDFS-11049.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux b1735ed036b5 3.13.0-96-generic #143-Ubuntu SMP Mon Aug 29 20:15:20 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / dbd2057 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HDFS-Build/17272/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17272/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17272/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        linyiqun Yiqun Lin added a comment -

        Thanks Akira Ajisaka for the quick look! Post a new patch to address the comment.

        Show
        linyiqun Yiqun Lin added a comment - Thanks Akira Ajisaka for the quick look! Post a new patch to address the comment.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Mostly looks good to me. Minor nit:

        The details of placing the replicas can see the javadoc in corresponding policy class.

        The details of placing replicas are documented in the javadoc of the corresponding policy classes.

        Show
        ajisakaa Akira Ajisaka added a comment - Mostly looks good to me. Minor nit: The details of placing the replicas can see the javadoc in corresponding policy class. The details of placing replicas are documented in the javadoc of the corresponding policy classes.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 1s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 6m 35s trunk passed
        +1 compile 0m 45s trunk passed
        +1 mvnsite 0m 51s trunk passed
        +1 mvneclipse 0m 12s trunk passed
        +1 javadoc 0m 38s trunk passed
        +1 mvninstall 0m 44s the patch passed
        +1 compile 0m 43s the patch passed
        +1 javac 0m 43s the patch passed
        +1 mvnsite 0m 47s the patch passed
        +1 mvneclipse 0m 9s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 javadoc 0m 36s the patch passed
        -1 unit 53m 56s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 16s The patch does not generate ASF License warnings.
        67m 29s



        Reason Tests
        Failed junit tests hadoop.hdfs.server.datanode.TestLargeBlockReport
        Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
          org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
          org.apache.hadoop.hdfs.server.namenode.TestINodeFile
          org.apache.hadoop.cli.TestCryptoAdminCLI
          org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
          org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck
          org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HDFS-11049
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835091/HDFS-11049.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
        uname Linux 39dfde3cfed3 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / dbd2057
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/17270/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17270/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17270/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 1s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 6m 35s trunk passed +1 compile 0m 45s trunk passed +1 mvnsite 0m 51s trunk passed +1 mvneclipse 0m 12s trunk passed +1 javadoc 0m 38s trunk passed +1 mvninstall 0m 44s the patch passed +1 compile 0m 43s the patch passed +1 javac 0m 43s the patch passed +1 mvnsite 0m 47s the patch passed +1 mvneclipse 0m 9s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 javadoc 0m 36s the patch passed -1 unit 53m 56s hadoop-hdfs in the patch failed. +1 asflicense 0m 16s The patch does not generate ASF License warnings. 67m 29s Reason Tests Failed junit tests hadoop.hdfs.server.datanode.TestLargeBlockReport Timed out junit tests org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   org.apache.hadoop.hdfs.server.namenode.TestINodeFile   org.apache.hadoop.cli.TestCryptoAdminCLI   org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing   org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck   org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HDFS-11049 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835091/HDFS-11049.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux 39dfde3cfed3 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / dbd2057 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HDFS-Build/17270/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17270/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17270/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        linyiqun Yiqun Lin added a comment -

        Hi Akira Ajisaka, could you please have a look? Thanks!

        Show
        linyiqun Yiqun Lin added a comment - Hi Akira Ajisaka , could you please have a look? Thanks!
        Hide
        linyiqun Yiqun Lin added a comment -

        Attach a initial patch.

        Show
        linyiqun Yiqun Lin added a comment - Attach a initial patch.

          People

          • Assignee:
            linyiqun Yiqun Lin
            Reporter:
            linyiqun Yiqun Lin
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development