Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6954

With crypto, no native lib systems are too verbose

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 2.6.0
    • Component/s: encryption
    • Labels:
      None

      Description

      Running commands on a machine without a native library results in:

      $ bin/hdfs dfs -put /etc/hosts /tmp
      14/08/27 07:16:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      14/08/27 07:16:11 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
      14/08/27 07:16:11 INFO hdfs.DFSClient: No KeyProvider found.
      

      This is way too much.

      1. HDFS-6954.001.patch
        2 kB
        Charles Lamb
      2. HDFS-6954.002.patch
        5 kB
        Charles Lamb
      3. HDFS-6954.003.patch
        5 kB
        Charles Lamb

        Activity

        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #1885 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1885/)
        HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java
        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1885 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1885/ ) HDFS-6954 . With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Hdfs-trunk #1860 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1860/)
        HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java
        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1860 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1860/ ) HDFS-6954 . With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #669 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/669/)
        HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9)

        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java
        • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #669 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/669/ ) HDFS-6954 . With crypto, no native lib systems are too verbose. Contributed by Charles Lamb. (wang: rev a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/PerformanceAdvisory.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoCodec.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Andrew Wang added a comment -

        Committed to trunk and branch-2, thanks Charles.

        Show
        Andrew Wang added a comment - Committed to trunk and branch-2, thanks Charles.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12665324/HDFS-6954.003.patch
        against trunk revision e1109fb.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl

        The test build failed in hadoop-hdfs-project/hadoop-hdfs

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7871//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7871//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665324/HDFS-6954.003.patch against trunk revision e1109fb. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl The test build failed in hadoop-hdfs-project/hadoop-hdfs +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7871//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7871//console This message is automatically generated.
        Hide
        Charles Lamb added a comment -

        Andrew Wang,

        Good idea. I've reverted those back to {} style formatting. I had changed them originally because warn doesn't have that style.

        I'm not sure what the rash of unit test failures is about. While it looks related, it also looks like a possible jenkins patch application/compilation failure. In any case, I ran a handful of the failed unit tests on my local machine and they passed. So perhaps it was spurious. We can see on the next jenkins run.

        Show
        Charles Lamb added a comment - Andrew Wang , Good idea. I've reverted those back to {} style formatting. I had changed them originally because warn doesn't have that style. I'm not sure what the rash of unit test failures is about. While it looks related, it also looks like a possible jenkins patch application/compilation failure. In any case, I ran a handful of the failed unit tests on my local machine and they passed. So perhaps it was spurious. We can see on the next jenkins run.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12665175/HDFS-6954.002.patch
        against trunk revision 7119bd4.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
        org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
        org.apache.hadoop.hdfs.server.namenode.TestMetadataVersionOutput
        org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean
        org.apache.hadoop.hdfs.TestDFSStorageStateRecovery
        org.apache.hadoop.hdfs.TestSeekBug
        org.apache.hadoop.hdfs.TestFileAppendRestart
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
        org.apache.hadoop.TestRefreshCallQueue
        org.apache.hadoop.hdfs.TestHdfsAdmin
        org.apache.hadoop.hdfs.TestGetBlocks
        org.apache.hadoop.hdfs.server.namenode.ha.TestDFSZKFailoverController
        org.apache.hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
        org.apache.hadoop.hdfs.server.datanode.TestHSync
        org.apache.hadoop.hdfs.server.namenode.TestStartup
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
        org.apache.hadoop.hdfs.TestDisableConnCache
        org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
        org.apache.hadoop.hdfs.TestRollingUpgradeRollback
        org.apache.hadoop.hdfs.TestDatanodeDeath
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
        org.apache.hadoop.hdfs.server.namenode.TestFileLimit
        org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
        org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead
        org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
        org.apache.hadoop.hdfs.TestFileAppend4
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
        org.apache.hadoop.hdfs.server.namenode.TestStorageRestore
        org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication
        org.apache.hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
        org.apache.hadoop.hdfs.TestDFSClientRetries
        org.apache.hadoop.hdfs.TestDataTransferKeepalive
        org.apache.hadoop.hdfs.server.namenode.TestAclConfigFlag
        org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction
        org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
        org.apache.hadoop.hdfs.TestReservedRawPaths
        org.apache.hadoop.hdfs.server.namenode.TestLeaseManager
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
        org.apache.hadoop.hdfs.server.datanode.TestIncrementalBlockReports
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
        org.apache.hadoop.hdfs.TestFileCreationClient
        org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer
        org.apache.hadoop.hdfs.TestWriteConfigurationToDFS
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
        org.apache.hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
        org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean
        org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
        org.apache.hadoop.hdfs.TestLocalDFS
        org.apache.hadoop.hdfs.TestDFSRename
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl
        org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache
        org.apache.hadoop.hdfs.TestListFilesInFileContext
        org.apache.hadoop.hdfs.server.namenode.TestDeleteRace
        org.apache.hadoop.hdfs.server.datanode.TestTransferRbw
        org.apache.hadoop.hdfs.TestReadWhileWriting
        org.apache.hadoop.hdfs.server.namenode.TestGenericJournalConf
        org.apache.hadoop.hdfs.TestDatanodeReport
        org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
        org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache
        org.apache.hadoop.hdfs.TestParallelRead
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
        org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus
        org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
        org.apache.hadoop.hdfs.TestHDFSTrash
        org.apache.hadoop.hdfs.TestDFSRollback
        org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl
        org.apache.hadoop.hdfs.security.token.block.TestBlockToken
        org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
        org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
        org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
        org.apache.hadoop.hdfs.TestFileCreation
        org.apache.hadoop.hdfs.TestSetrepIncreasing
        org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
        org.apache.hadoop.hdfs.TestDatanodeConfig
        org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams
        org.apache.hadoop.hdfs.TestFileAppend3
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
        org.apache.hadoop.hdfs.security.TestDelegationToken
        org.apache.hadoop.tracing.TestTracing
        org.apache.hadoop.hdfs.server.datanode.TestDiskError
        org.apache.hadoop.hdfs.TestClientReportBadBlock
        org.apache.hadoop.hdfs.TestDataTransferProtocol
        org.apache.hadoop.hdfs.TestWriteRead
        org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll
        org.apache.hadoop.hdfs.TestClose
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeRpcServer
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
        org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
        org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
        org.apache.hadoop.hdfs.TestFileAppend
        org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations
        org.apache.hadoop.hdfs.TestDFSPermission
        org.apache.hadoop.hdfs.TestBalancerBandwidth
        org.apache.hadoop.hdfs.TestMiniDFSCluster
        org.apache.hadoop.hdfs.TestPread
        org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
        org.apache.hadoop.hdfs.TestDatanodeRegistration
        org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
        org.apache.hadoop.hdfs.server.namenode.TestSecondaryWebUi
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl
        org.apache.hadoop.hdfs.TestDFSShellGenericOptions
        org.apache.hadoop.hdfs.TestRenameWhileOpen
        org.apache.hadoop.hdfs.tools.TestGetGroups
        org.apache.hadoop.hdfs.server.namenode.TestBackupNode
        org.apache.hadoop.hdfs.TestAbandonBlock
        org.apache.hadoop.hdfs.TestRestartDFS
        org.apache.hadoop.hdfs.TestSmallBlock
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
        org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade
        org.apache.hadoop.hdfs.TestSafeMode
        org.apache.hadoop.hdfs.server.namenode.TestEditLog
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
        org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
        org.apache.hadoop.hdfs.server.namenode.TestTransferFsImage
        org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
        org.apache.hadoop.hdfs.TestDFSOutputStream
        org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
        org.apache.hadoop.hdfs.TestEncryptionZones
        org.apache.hadoop.hdfs.TestFileConcurrentReader
        org.apache.hadoop.hdfs.TestFsShellPermission
        org.apache.hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
        org.apache.hadoop.hdfs.server.namenode.TestEditLogRace
        org.apache.hadoop.hdfs.TestDFSRemove
        org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace
        org.apache.hadoop.hdfs.TestHFlush
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
        org.apache.hadoop.hdfs.TestMultiThreadedHflush
        org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
        org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
        org.apache.hadoop.net.TestNetworkTopology
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
        org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
        org.apache.hadoop.hdfs.TestClientBlockVerification
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
        org.apache.hadoop.hdfs.TestAppendDifferentChecksum
        org.apache.hadoop.hdfs.TestDFSFinalize
        org.apache.hadoop.hdfs.TestSetrepDecreasing
        org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeExit
        org.apache.hadoop.hdfs.TestCrcCorruption
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
        org.apache.hadoop.hdfs.TestFileCreationDelete
        org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure
        org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
        org.apache.hadoop.hdfs.server.namenode.TestAuditLogs
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
        org.apache.hadoop.hdfs.TestPipelines
        org.apache.hadoop.hdfs.TestLeaseRecovery
        org.apache.hadoop.hdfs.TestDFSUpgradeFromImage
        org.apache.hadoop.hdfs.server.datanode.TestStorageReport
        org.apache.hadoop.hdfs.server.namenode.TestMetaSave
        org.apache.hadoop.hdfs.TestLease
        org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
        org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
        org.apache.hadoop.hdfs.TestSnapshotCommands
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
        org.apache.hadoop.hdfs.TestFileCreationEmpty
        org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy
        org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
        org.apache.hadoop.hdfs.TestFSInputChecker
        org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
        org.apache.hadoop.hdfs.server.namenode.TestEditLogJournalFailures
        org.apache.hadoop.hdfs.TestLargeBlock
        org.apache.hadoop.hdfs.TestDatanodeBlockScanner
        org.apache.hadoop.hdfs.server.namenode.TestXAttrConfigFlag
        org.apache.hadoop.hdfs.TestReplication
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend
        org.apache.hadoop.hdfs.server.namenode.TestAllowFormat
        org.apache.hadoop.hdfs.server.namenode.TestFsck
        org.apache.hadoop.hdfs.qjournal.TestNNWithQJM
        org.apache.hadoop.hdfs.TestModTime
        org.apache.hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
        org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery
        org.apache.hadoop.hdfs.server.datanode.TestRefreshNamenodes
        org.apache.hadoop.hdfs.server.namenode.TestSequentialBlockId
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
        org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery
        org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
        org.apache.hadoop.hdfs.TestDistributedFileSystem
        org.apache.hadoop.hdfs.TestHDFSFileSystemContract
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
        org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
        org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog
        org.apache.hadoop.hdfs.TestConnCache
        org.apache.hadoop.hdfs.TestDFSStartupVersions
        org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
        org.apache.hadoop.hdfs.TestGetFileChecksum
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
        org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
        org.apache.hadoop.hdfs.TestDFSClientFailover
        org.apache.hadoop.hdfs.TestDFSMkdirs
        org.apache.hadoop.hdfs.TestDFSClientExcludedNodes
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeInitStorage
        org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
        org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
        org.apache.hadoop.hdfs.TestBlockReaderFactory
        org.apache.hadoop.hdfs.TestDFSUpgrade
        org.apache.hadoop.hdfs.server.namenode.TestAddBlock
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
        org.apache.hadoop.hdfs.TestFetchImage
        org.apache.hadoop.hdfs.server.namenode.TestFSDirectory
        org.apache.hadoop.hdfs.TestDFSAddressConfig
        org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
        org.apache.hadoop.hdfs.TestLeaseRecovery2
        org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser
        org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
        org.apache.hadoop.hdfs.TestFileStatus
        org.apache.hadoop.hdfs.server.namenode.TestHostsFiles
        org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives
        org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
        org.apache.hadoop.hdfs.TestPersistBlocks
        org.apache.hadoop.hdfs.server.namenode.TestINodeFile
        org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade
        org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
        org.apache.hadoop.hdfs.TestDFSShell
        org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr
        org.apache.hadoop.hdfs.TestMissingBlocksAlert
        org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount
        org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner
        org.apache.hadoop.hdfs.TestIsMethodSupported
        org.apache.hadoop.hdfs.TestBlockMissingException
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
        org.apache.hadoop.hdfs.TestSetTimes
        org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
        org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
        org.apache.hadoop.hdfs.TestFSOutputSummer
        org.apache.hadoop.hdfs.server.balancer.TestBalancer
        org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
        org.apache.hadoop.hdfs.TestEncryptedTransfer
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
        org.apache.hadoop.hdfs.server.namenode.TestFSImage
        org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
        org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite
        org.apache.hadoop.hdfs.TestRollingUpgrade
        org.apache.hadoop.hdfs.TestQuota
        org.apache.hadoop.hdfs.server.namenode.TestAuditLogger
        org.apache.hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7848//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7848//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665175/HDFS-6954.002.patch against trunk revision 7119bd4. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat org.apache.hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler org.apache.hadoop.hdfs.server.namenode.TestMetadataVersionOutput org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean org.apache.hadoop.hdfs.TestDFSStorageStateRecovery org.apache.hadoop.hdfs.TestSeekBug org.apache.hadoop.hdfs.TestFileAppendRestart org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica org.apache.hadoop.TestRefreshCallQueue org.apache.hadoop.hdfs.TestHdfsAdmin org.apache.hadoop.hdfs.TestGetBlocks org.apache.hadoop.hdfs.server.namenode.ha.TestDFSZKFailoverController org.apache.hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling org.apache.hadoop.hdfs.server.datanode.TestHSync org.apache.hadoop.hdfs.server.namenode.TestStartup org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer org.apache.hadoop.hdfs.TestDisableConnCache org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock org.apache.hadoop.hdfs.TestRollingUpgradeRollback org.apache.hadoop.hdfs.TestDatanodeDeath org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics org.apache.hadoop.hdfs.server.namenode.TestFileLimit org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics org.apache.hadoop.hdfs.TestFileAppend4 org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks org.apache.hadoop.hdfs.server.namenode.TestStorageRestore org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication org.apache.hadoop.hdfs.server.namenode.TestSecurityTokenEditLog org.apache.hadoop.hdfs.TestDFSClientRetries org.apache.hadoop.hdfs.TestDataTransferKeepalive org.apache.hadoop.hdfs.server.namenode.TestAclConfigFlag org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport org.apache.hadoop.hdfs.TestReservedRawPaths org.apache.hadoop.hdfs.server.namenode.TestLeaseManager org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS org.apache.hadoop.hdfs.server.datanode.TestIncrementalBlockReports org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes org.apache.hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations org.apache.hadoop.hdfs.TestFileCreationClient org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer org.apache.hadoop.hdfs.TestWriteConfigurationToDFS org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics org.apache.hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade org.apache.hadoop.hdfs.server.namenode.TestAddBlockRetry org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport org.apache.hadoop.hdfs.TestLocalDFS org.apache.hadoop.hdfs.TestDFSRename org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.hdfs.TestListFilesInFileContext org.apache.hadoop.hdfs.server.namenode.TestDeleteRace org.apache.hadoop.hdfs.server.datanode.TestTransferRbw org.apache.hadoop.hdfs.TestReadWhileWriting org.apache.hadoop.hdfs.server.namenode.TestGenericJournalConf org.apache.hadoop.hdfs.TestDatanodeReport org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks org.apache.hadoop.hdfs.server.namenode.TestNameNodeResourceChecker org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache org.apache.hadoop.hdfs.TestParallelRead org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN org.apache.hadoop.hdfs.TestHDFSTrash org.apache.hadoop.hdfs.TestDFSRollback org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl org.apache.hadoop.hdfs.security.token.block.TestBlockToken org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold org.apache.hadoop.hdfs.TestFileCreation org.apache.hadoop.hdfs.TestSetrepIncreasing org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA org.apache.hadoop.hdfs.TestDatanodeConfig org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams org.apache.hadoop.hdfs.TestFileAppend3 org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication org.apache.hadoop.hdfs.security.TestDelegationToken org.apache.hadoop.tracing.TestTracing org.apache.hadoop.hdfs.server.datanode.TestDiskError org.apache.hadoop.hdfs.TestClientReportBadBlock org.apache.hadoop.hdfs.TestDataTransferProtocol org.apache.hadoop.hdfs.TestWriteRead org.apache.hadoop.hdfs.server.namenode.TestEditLogAutoroll org.apache.hadoop.hdfs.TestClose org.apache.hadoop.hdfs.server.namenode.TestNameNodeRpcServer org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot org.apache.hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure org.apache.hadoop.hdfs.TestFileAppend org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations org.apache.hadoop.hdfs.TestDFSPermission org.apache.hadoop.hdfs.TestBalancerBandwidth org.apache.hadoop.hdfs.TestMiniDFSCluster org.apache.hadoop.hdfs.TestPread org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits org.apache.hadoop.hdfs.TestDatanodeRegistration org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs org.apache.hadoop.hdfs.server.namenode.TestSecondaryWebUi org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl org.apache.hadoop.hdfs.TestDFSShellGenericOptions org.apache.hadoop.hdfs.TestRenameWhileOpen org.apache.hadoop.hdfs.tools.TestGetGroups org.apache.hadoop.hdfs.server.namenode.TestBackupNode org.apache.hadoop.hdfs.TestAbandonBlock org.apache.hadoop.hdfs.TestRestartDFS org.apache.hadoop.hdfs.TestSmallBlock org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade org.apache.hadoop.hdfs.TestSafeMode org.apache.hadoop.hdfs.server.namenode.TestEditLog org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy org.apache.hadoop.hdfs.server.namenode.TestTransferFsImage org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename org.apache.hadoop.hdfs.TestDFSOutputStream org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl org.apache.hadoop.hdfs.TestEncryptionZones org.apache.hadoop.hdfs.TestFileConcurrentReader org.apache.hadoop.hdfs.TestFsShellPermission org.apache.hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional org.apache.hadoop.hdfs.server.namenode.TestEditLogRace org.apache.hadoop.hdfs.TestDFSRemove org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace org.apache.hadoop.hdfs.TestHFlush org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots org.apache.hadoop.hdfs.TestMultiThreadedHflush org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA org.apache.hadoop.net.TestNetworkTopology org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover org.apache.hadoop.hdfs.TestClientBlockVerification org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion org.apache.hadoop.hdfs.TestAppendDifferentChecksum org.apache.hadoop.hdfs.TestDFSFinalize org.apache.hadoop.hdfs.TestSetrepDecreasing org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode org.apache.hadoop.hdfs.server.datanode.TestDataNodeExit org.apache.hadoop.hdfs.TestCrcCorruption org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement org.apache.hadoop.hdfs.TestFileCreationDelete org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner org.apache.hadoop.hdfs.server.namenode.TestAuditLogs org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints org.apache.hadoop.hdfs.TestPipelines org.apache.hadoop.hdfs.TestLeaseRecovery org.apache.hadoop.hdfs.TestDFSUpgradeFromImage org.apache.hadoop.hdfs.server.datanode.TestStorageReport org.apache.hadoop.hdfs.server.namenode.TestMetaSave org.apache.hadoop.hdfs.TestLease org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean org.apache.hadoop.hdfs.TestSnapshotCommands org.apache.hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot org.apache.hadoop.hdfs.TestFileCreationEmpty org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA org.apache.hadoop.hdfs.TestFSInputChecker org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint org.apache.hadoop.hdfs.server.namenode.TestEditLogJournalFailures org.apache.hadoop.hdfs.TestLargeBlock org.apache.hadoop.hdfs.TestDatanodeBlockScanner org.apache.hadoop.hdfs.server.namenode.TestXAttrConfigFlag org.apache.hadoop.hdfs.TestReplication org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend org.apache.hadoop.hdfs.server.namenode.TestAllowFormat org.apache.hadoop.hdfs.server.namenode.TestFsck org.apache.hadoop.hdfs.qjournal.TestNNWithQJM org.apache.hadoop.hdfs.TestModTime org.apache.hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps org.apache.hadoop.hdfs.server.namenode.TestNameNodeRecovery org.apache.hadoop.hdfs.server.datanode.TestRefreshNamenodes org.apache.hadoop.hdfs.server.namenode.TestSequentialBlockId org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract org.apache.hadoop.hdfs.TestDistributedFileSystem org.apache.hadoop.hdfs.TestHDFSFileSystemContract org.apache.hadoop.hdfs.server.datanode.TestDataNodeMXBean org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure org.apache.hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog org.apache.hadoop.hdfs.TestConnCache org.apache.hadoop.hdfs.TestDFSStartupVersions org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby org.apache.hadoop.hdfs.TestGetFileChecksum org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate org.apache.hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer org.apache.hadoop.hdfs.TestDFSClientFailover org.apache.hadoop.hdfs.TestDFSMkdirs org.apache.hadoop.hdfs.TestDFSClientExcludedNodes org.apache.hadoop.hdfs.server.datanode.TestDataNodeInitStorage org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage org.apache.hadoop.hdfs.server.namenode.TestCheckpoint org.apache.hadoop.hdfs.TestBlockReaderFactory org.apache.hadoop.hdfs.TestDFSUpgrade org.apache.hadoop.hdfs.server.namenode.TestAddBlock org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot org.apache.hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys org.apache.hadoop.hdfs.TestFetchImage org.apache.hadoop.hdfs.server.namenode.TestFSDirectory org.apache.hadoop.hdfs.TestDFSAddressConfig org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer org.apache.hadoop.hdfs.TestLeaseRecovery2 org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality org.apache.hadoop.hdfs.TestFileStatus org.apache.hadoop.hdfs.server.namenode.TestHostsFiles org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA org.apache.hadoop.hdfs.TestPersistBlocks org.apache.hadoop.hdfs.server.namenode.TestINodeFile org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA org.apache.hadoop.hdfs.TestDFSShell org.apache.hadoop.hdfs.server.namenode.TestFileContextXAttr org.apache.hadoop.hdfs.TestMissingBlocksAlert org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner org.apache.hadoop.hdfs.TestIsMethodSupported org.apache.hadoop.hdfs.TestBlockMissingException org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing org.apache.hadoop.hdfs.TestSetTimes org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead org.apache.hadoop.hdfs.TestFSOutputSummer org.apache.hadoop.hdfs.server.balancer.TestBalancer org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol org.apache.hadoop.hdfs.TestEncryptedTransfer org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration org.apache.hadoop.hdfs.server.namenode.TestFSImage org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite org.apache.hadoop.hdfs.TestRollingUpgrade org.apache.hadoop.hdfs.TestQuota org.apache.hadoop.hdfs.server.namenode.TestAuditLogger org.apache.hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7848//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7848//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12664990/HDFS-6954.001.patch
        against trunk revision 48aa3b7.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to cause Findbugs (version 2.0.3) to fail.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
        org.apache.hadoop.hdfs.TestHDFSFileSystemContract
        org.apache.hadoop.hdfs.TestEncryptedTransfer
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
        org.apache.hadoop.hdfs.web.TestWebHDFSForHA
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
        org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery
        org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek
        org.apache.hadoop.hdfs.TestPread
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
        org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs
        org.apache.hadoop.hdfs.TestWriteConfigurationToDFS
        org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead
        org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams
        org.apache.hadoop.hdfs.server.datanode.TestTransferRbw
        org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
        org.apache.hadoop.hdfs.server.namenode.TestAddBlock
        org.apache.hadoop.fs.TestSymlinkHdfsDisable
        org.apache.hadoop.hdfs.TestDecommission
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl
        org.apache.hadoop.hdfs.TestDFSRemove
        org.apache.hadoop.fs.loadGenerator.TestLoadGenerator
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
        org.apache.hadoop.hdfs.TestFileAppend4
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
        org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
        org.apache.hadoop.security.TestPermission
        org.apache.hadoop.hdfs.TestDFSShell
        org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount
        org.apache.hadoop.hdfs.server.namenode.TestDeleteRace
        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
        org.apache.hadoop.hdfs.TestDFSClientFailover
        org.apache.hadoop.hdfs.TestModTime
        org.apache.hadoop.hdfs.TestDistributedFileSystem
        org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
        org.apache.hadoop.hdfs.web.TestWebHDFS
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
        org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
        org.apache.hadoop.hdfs.TestDFSUpgrade
        org.apache.hadoop.hdfs.TestParallelRead
        org.apache.hadoop.security.TestPermissionSymlinks
        org.apache.hadoop.hdfs.TestClientBlockVerification
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
        org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
        org.apache.hadoop.hdfs.TestPersistBlocks
        org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool
        org.apache.hadoop.hdfs.TestRenameWhileOpen
        org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage
        org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy
        org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus
        org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        org.apache.hadoop.hdfs.TestHFlush
        org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen
        org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
        org.apache.hadoop.fs.TestFcHdfsPermission
        org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
        org.apache.hadoop.hdfs.TestClose
        org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
        org.apache.hadoop.hdfs.TestLeaseRecovery2
        org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl
        org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
        org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
        org.apache.hadoop.hdfs.TestLeaseRecovery
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir
        org.apache.hadoop.hdfs.TestDatanodeBlockScanner
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
        org.apache.hadoop.hdfs.TestDFSFinalize
        org.apache.hadoop.hdfs.security.token.block.TestBlockToken
        org.apache.hadoop.hdfs.TestDFSStorageStateRecovery
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
        org.apache.hadoop.fs.TestUrlStreamHandler
        org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure
        org.apache.hadoop.hdfs.server.namenode.TestHostsFiles
        org.apache.hadoop.hdfs.TestDFSPermission
        org.apache.hadoop.hdfs.server.datanode.TestDiskError
        org.apache.hadoop.fs.TestSymlinkHdfsFileSystem
        org.apache.hadoop.hdfs.TestListFilesInDFS
        org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite
        org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
        org.apache.hadoop.hdfs.web.TestWebHdfsTokens
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
        org.apache.hadoop.hdfs.server.namenode.TestMetaSave
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
        org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
        org.apache.hadoop.hdfs.TestDFSRename
        org.apache.hadoop.hdfs.TestParallelUnixDomainRead
        org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot
        org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
        org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
        org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
        org.apache.hadoop.hdfs.TestDataTransferProtocol
        org.apache.hadoop.hdfs.TestQuota
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
        org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete
        org.apache.hadoop.hdfs.TestMissingBlocksAlert
        org.apache.hadoop.fs.TestGlobPaths
        org.apache.hadoop.hdfs.TestFSOutputSummer
        org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
        org.apache.hadoop.hdfs.TestFileConcurrentReader
        org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat
        org.apache.hadoop.fs.TestEnhancedByteBufferAccess
        org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
        org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
        org.apache.hadoop.hdfs.TestMultiThreadedHflush
        org.apache.hadoop.hdfs.TestEncryptionZones
        org.apache.hadoop.hdfs.security.TestDelegationToken
        org.apache.hadoop.hdfs.TestConnCache
        org.apache.hadoop.hdfs.server.namenode.TestFSImage
        org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat
        org.apache.hadoop.hdfs.server.datanode.TestHSync
        org.apache.hadoop.hdfs.TestRead
        org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes
        org.apache.hadoop.hdfs.TestSetTimes
        org.apache.hadoop.hdfs.TestFileCreationEmpty
        org.apache.hadoop.hdfs.TestDisableConnCache
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
        org.apache.hadoop.hdfs.TestDFSOutputStream
        org.apache.hadoop.hdfs.TestSmallBlock
        org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl
        org.apache.hadoop.fs.TestFcHdfsSetUMask
        org.apache.hadoop.hdfs.TestFsShellPermission
        org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace
        org.apache.hadoop.hdfs.server.namenode.TestBackupNode
        org.apache.hadoop.tracing.TestTracing
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
        org.apache.hadoop.hdfs.TestGetFileChecksum
        org.apache.hadoop.cli.TestXAttrCLI
        org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery
        org.apache.hadoop.hdfs.TestFileAppend
        org.apache.hadoop.hdfs.TestLocalDFS
        org.apache.hadoop.hdfs.server.balancer.TestBalancer
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
        org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
        org.apache.hadoop.hdfs.TestDFSMkdirs
        org.apache.hadoop.fs.TestSymlinkHdfsFileContext
        org.apache.hadoop.hdfs.TestFileStatus
        org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations
        org.apache.hadoop.hdfs.TestHDFSTrash
        org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.TestFsck
        org.apache.hadoop.hdfs.TestLease
        org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
        org.apache.hadoop.hdfs.TestLargeBlock
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend
        org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement
        org.apache.hadoop.hdfs.TestClientReportBadBlock
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
        org.apache.hadoop.hdfs.TestSetrepDecreasing
        org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction
        org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser
        org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
        org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
        org.apache.hadoop.fs.TestResolveHdfsSymlink
        org.apache.hadoop.fs.shell.TestHdfsTextCommand
        org.apache.hadoop.cli.TestAclCLI
        org.apache.hadoop.hdfs.TestBlocksScheduledCounter
        org.apache.hadoop.hdfs.server.namenode.TestFileLimit
        org.apache.hadoop.hdfs.server.namenode.TestFSDirectory
        org.apache.hadoop.tools.TestJMXGet
        org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
        org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
        org.apache.hadoop.fs.TestFcHdfsCreateMkdir
        org.apache.hadoop.hdfs.TestFileAppendRestart
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
        org.apache.hadoop.cli.TestHDFSCLI
        org.apache.hadoop.hdfs.server.namenode.TestAuditLogs
        org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs
        org.apache.hadoop.fs.TestHDFSFileContextMainOperations
        org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart
        org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
        org.apache.hadoop.hdfs.TestListFilesInFileContext
        org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
        org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
        org.apache.hadoop.hdfs.TestCrcCorruption
        org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
        org.apache.hadoop.hdfs.TestReadWhileWriting
        org.apache.hadoop.hdfs.TestFileAppend3
        org.apache.hadoop.hdfs.TestBlockReaderFactory
        org.apache.hadoop.hdfs.TestReplication
        org.apache.hadoop.hdfs.TestGetBlocks
        org.apache.hadoop.hdfs.TestDFSStartupVersions
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate
        org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr
        org.apache.hadoop.hdfs.server.namenode.TestSequentialBlockId
        org.apache.hadoop.hdfs.web.TestHttpsFileSystem
        org.apache.hadoop.hdfs.server.namenode.TestStartup
        org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
        org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives
        org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
        org.apache.hadoop.hdfs.server.namenode.TestINodeFile
        org.apache.hadoop.hdfs.TestSetrepIncreasing
        org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
        org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend
        org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
        org.apache.hadoop.hdfs.web.TestWebHDFSAcl
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
        org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot
        org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
        org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
        org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
        org.apache.hadoop.hdfs.TestFSInputChecker
        org.apache.hadoop.fs.permission.TestStickyBit
        org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner
        org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue
        org.apache.hadoop.fs.viewfs.TestViewFsHdfs
        org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
        org.apache.hadoop.cli.TestCryptoAdminCLI
        org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
        org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
        org.apache.hadoop.hdfs.TestDataTransferKeepalive
        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes

        The following test timeouts occurred in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7845//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7845//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664990/HDFS-6954.001.patch against trunk revision 48aa3b7. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to cause Findbugs (version 2.0.3) to fail. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer org.apache.hadoop.hdfs.TestHDFSFileSystemContract org.apache.hadoop.hdfs.TestEncryptedTransfer org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport org.apache.hadoop.hdfs.web.TestWebHDFSForHA org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek org.apache.hadoop.hdfs.TestPread org.apache.hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs org.apache.hadoop.hdfs.TestWriteConfigurationToDFS org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams org.apache.hadoop.hdfs.server.datanode.TestTransferRbw org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint org.apache.hadoop.hdfs.server.namenode.TestAddBlock org.apache.hadoop.fs.TestSymlinkHdfsDisable org.apache.hadoop.hdfs.TestDecommission org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl org.apache.hadoop.hdfs.TestDFSRemove org.apache.hadoop.fs.loadGenerator.TestLoadGenerator org.apache.hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication org.apache.hadoop.hdfs.TestFileAppend4 org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength org.apache.hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport org.apache.hadoop.security.TestPermission org.apache.hadoop.hdfs.TestDFSShell org.apache.hadoop.hdfs.server.blockmanagement.TestNodeCount org.apache.hadoop.hdfs.server.namenode.TestDeleteRace org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade org.apache.hadoop.hdfs.TestDFSClientFailover org.apache.hadoop.hdfs.TestModTime org.apache.hadoop.hdfs.TestDistributedFileSystem org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy org.apache.hadoop.hdfs.web.TestWebHDFS org.apache.hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot org.apache.hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot org.apache.hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks org.apache.hadoop.hdfs.TestDFSUpgrade org.apache.hadoop.hdfs.TestParallelRead org.apache.hadoop.security.TestPermissionSymlinks org.apache.hadoop.hdfs.TestClientBlockVerification org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion org.apache.hadoop.hdfs.TestPersistBlocks org.apache.hadoop.hdfs.server.datanode.TestDeleteBlockPool org.apache.hadoop.hdfs.TestRenameWhileOpen org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage org.apache.hadoop.hdfs.server.datanode.TestCachingStrategy org.apache.hadoop.hdfs.server.namenode.TestDecommissioningStatus org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA org.apache.hadoop.hdfs.TestHFlush org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap org.apache.hadoop.fs.TestFcHdfsPermission org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA org.apache.hadoop.hdfs.TestClose org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner org.apache.hadoop.hdfs.TestLeaseRecovery2 org.apache.hadoop.hdfs.server.namenode.TestFileContextAcl org.apache.hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation org.apache.hadoop.hdfs.server.datanode.TestReadOnlySharedStorage org.apache.hadoop.hdfs.TestLeaseRecovery org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir org.apache.hadoop.hdfs.TestDatanodeBlockScanner org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure org.apache.hadoop.hdfs.TestDFSFinalize org.apache.hadoop.hdfs.security.token.block.TestBlockToken org.apache.hadoop.hdfs.TestDFSStorageStateRecovery org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement org.apache.hadoop.fs.TestUrlStreamHandler org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure org.apache.hadoop.hdfs.server.namenode.TestHostsFiles org.apache.hadoop.hdfs.TestDFSPermission org.apache.hadoop.hdfs.server.datanode.TestDiskError org.apache.hadoop.fs.TestSymlinkHdfsFileSystem org.apache.hadoop.hdfs.TestListFilesInDFS org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled org.apache.hadoop.hdfs.web.TestWebHdfsTokens org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport org.apache.hadoop.hdfs.server.namenode.TestMetaSave org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot org.apache.hadoop.hdfs.TestDFSRename org.apache.hadoop.hdfs.TestParallelUnixDomainRead org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot org.apache.hadoop.hdfs.TestDataTransferProtocol org.apache.hadoop.hdfs.TestQuota org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing org.apache.hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete org.apache.hadoop.hdfs.TestMissingBlocksAlert org.apache.hadoop.fs.TestGlobPaths org.apache.hadoop.hdfs.TestFSOutputSummer org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock org.apache.hadoop.hdfs.TestFileConcurrentReader org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages org.apache.hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots org.apache.hadoop.hdfs.server.namenode.TestNameNodeXAttr org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat org.apache.hadoop.fs.TestEnhancedByteBufferAccess org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract org.apache.hadoop.hdfs.TestMultiThreadedHflush org.apache.hadoop.hdfs.TestEncryptionZones org.apache.hadoop.hdfs.security.TestDelegationToken org.apache.hadoop.hdfs.TestConnCache org.apache.hadoop.hdfs.server.namenode.TestFSImage org.apache.hadoop.hdfs.server.namenode.TestHDFSConcat org.apache.hadoop.hdfs.server.datanode.TestHSync org.apache.hadoop.hdfs.TestRead org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes org.apache.hadoop.hdfs.TestSetTimes org.apache.hadoop.hdfs.TestFileCreationEmpty org.apache.hadoop.hdfs.TestDisableConnCache org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename org.apache.hadoop.hdfs.TestDFSOutputStream org.apache.hadoop.hdfs.TestSmallBlock org.apache.hadoop.hdfs.server.namenode.TestNameNodeAcl org.apache.hadoop.fs.TestFcHdfsSetUMask org.apache.hadoop.hdfs.TestFsShellPermission org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace org.apache.hadoop.hdfs.server.namenode.TestBackupNode org.apache.hadoop.tracing.TestTracing org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions org.apache.hadoop.hdfs.TestGetFileChecksum org.apache.hadoop.cli.TestXAttrCLI org.apache.hadoop.hdfs.server.datanode.TestBlockRecovery org.apache.hadoop.hdfs.TestFileAppend org.apache.hadoop.hdfs.TestLocalDFS org.apache.hadoop.hdfs.server.balancer.TestBalancer org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks org.apache.hadoop.hdfs.TestDFSMkdirs org.apache.hadoop.fs.TestSymlinkHdfsFileContext org.apache.hadoop.hdfs.TestFileStatus org.apache.hadoop.hdfs.server.datanode.TestIncrementalBrVariations org.apache.hadoop.hdfs.TestHDFSTrash org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA org.apache.hadoop.hdfs.server.namenode.TestFSImageWithSnapshot org.apache.hadoop.hdfs.server.namenode.TestFsck org.apache.hadoop.hdfs.TestLease org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer org.apache.hadoop.hdfs.TestLargeBlock org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend org.apache.hadoop.hdfs.server.datanode.TestBlockReplacement org.apache.hadoop.hdfs.TestClientReportBadBlock org.apache.hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots org.apache.hadoop.hdfs.TestSetrepDecreasing org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting org.apache.hadoop.fs.TestResolveHdfsSymlink org.apache.hadoop.fs.shell.TestHdfsTextCommand org.apache.hadoop.cli.TestAclCLI org.apache.hadoop.hdfs.TestBlocksScheduledCounter org.apache.hadoop.hdfs.server.namenode.TestFileLimit org.apache.hadoop.hdfs.server.namenode.TestFSDirectory org.apache.hadoop.tools.TestJMXGet org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer org.apache.hadoop.fs.TestFcHdfsCreateMkdir org.apache.hadoop.hdfs.TestFileAppendRestart org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer org.apache.hadoop.cli.TestHDFSCLI org.apache.hadoop.hdfs.server.namenode.TestAuditLogs org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs org.apache.hadoop.fs.TestHDFSFileContextMainOperations org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart org.apache.hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality org.apache.hadoop.hdfs.TestListFilesInFileContext org.apache.hadoop.hdfs.server.namenode.TestCheckpoint org.apache.hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold org.apache.hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots org.apache.hadoop.hdfs.TestCrcCorruption org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol org.apache.hadoop.hdfs.TestReadWhileWriting org.apache.hadoop.hdfs.TestFileAppend3 org.apache.hadoop.hdfs.TestBlockReaderFactory org.apache.hadoop.hdfs.TestReplication org.apache.hadoop.hdfs.TestGetBlocks org.apache.hadoop.hdfs.TestDFSStartupVersions org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr org.apache.hadoop.hdfs.server.namenode.TestSequentialBlockId org.apache.hadoop.hdfs.web.TestHttpsFileSystem org.apache.hadoop.hdfs.server.namenode.TestStartup org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum org.apache.hadoop.hdfs.server.namenode.TestCacheDirectives org.apache.hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd org.apache.hadoop.hdfs.server.namenode.TestINodeFile org.apache.hadoop.hdfs.TestSetrepIncreasing org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA org.apache.hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes org.apache.hadoop.hdfs.web.TestWebHDFSAcl org.apache.hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS org.apache.hadoop.hdfs.TestFSInputChecker org.apache.hadoop.fs.permission.TestStickyBit org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue org.apache.hadoop.fs.viewfs.TestViewFsHdfs org.apache.hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration org.apache.hadoop.cli.TestCryptoAdminCLI org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory org.apache.hadoop.hdfs.TestDataTransferKeepalive org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes The following test timeouts occurred in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7845//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7845//console This message is automatically generated.
        Hide
        Andrew Wang added a comment -

        Hey Charles, could you use slf4j style "{}" template strings to avoid string construction in the LOG calls? I haven't checked if it's necessary, but converting all of CryptoCodec to do this would be nice.

        Show
        Andrew Wang added a comment - Hey Charles, could you use slf4j style "{}" template strings to avoid string construction in the LOG calls? I haven't checked if it's necessary, but converting all of CryptoCodec to do this would be nice.
        Hide
        Charles Lamb added a comment -

        Thanks for the review Andrew Wang.

        I've attached the .002 version which is rebased and should address your comments. The change to use slf4j in PA was trivial.

        Show
        Charles Lamb added a comment - Thanks for the review Andrew Wang . I've attached the .002 version which is rebased and should address your comments. The change to use slf4j in PA was trivial.
        Hide
        Andrew Wang added a comment -

        Hi Charles, thanks for picking this up (and thanks Allen for reporting, I was going to file the same thing). Had a few review comments:

        • I think PerformanceAdvisory would be a nice logsink to use for the CryptoCodec stuff, it definitely relates to perf. Could do it at DEBUG level.
        • Would be nice to switch PerfAdvisory to use slf4j too. If this gets too big, we can do it in a different JIRA (or simply rename this one to be more general, i.e. "Add additional PerformanceAdvisory logging").
        Show
        Andrew Wang added a comment - Hi Charles, thanks for picking this up (and thanks Allen for reporting, I was going to file the same thing). Had a few review comments: I think PerformanceAdvisory would be a nice logsink to use for the CryptoCodec stuff, it definitely relates to perf. Could do it at DEBUG level. Would be nice to switch PerfAdvisory to use slf4j too. If this gets too big, we can do it in a different JIRA (or simply rename this one to be more general, i.e. "Add additional PerformanceAdvisory logging").
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12664990/HDFS-6954.001.patch
        against trunk revision c4c9a78.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 javac. The applied patch generated 1263 javac compiler warnings (more than the trunk's current 802 warnings).

        -1 javadoc. The javadoc tool appears to have generated 9 warning messages.
        See https://builds.apache.org/job/PreCommit-HDFS-Build/7828//artifact/trunk/patchprocess/diffJavadocWarnings.txt for details.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
        org.apache.hadoop.hdfs.TestDatanodeBlockScanner
        org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
        org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

        The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestDecommission

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//testReport/
        Javac warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//artifact/trunk/patchprocess/diffJavacWarnings.txt
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664990/HDFS-6954.001.patch against trunk revision c4c9a78. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 javac . The applied patch generated 1263 javac compiler warnings (more than the trunk's current 802 warnings). -1 javadoc . The javadoc tool appears to have generated 9 warning messages. See https://builds.apache.org/job/PreCommit-HDFS-Build/7828//artifact/trunk/patchprocess/diffJavadocWarnings.txt for details. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer org.apache.hadoop.hdfs.TestDatanodeBlockScanner org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestDecommission +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//testReport/ Javac warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7828//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org
        against trunk revision c4c9a78.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7827//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org against trunk revision c4c9a78. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7827//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org
        against trunk revision c4c9a78.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7825//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org against trunk revision c4c9a78. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7825//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org
        against trunk revision c4c9a78.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7824//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org against trunk revision c4c9a78. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7824//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org
        against trunk revision c4c9a78.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7821//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org against trunk revision c4c9a78. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7821//console This message is automatically generated.
        Hide
        Charles Lamb added a comment -

        Attached is a patch which changes the CryptoCodec and DFSClient messages from warn to debug. I considered changing the former to use the new PerformanceAdvisory log sink, but that still wouldn't suppress the messages per Allen's comment.

        wrt distcp, I did not change the tools.DistCp or client.RMProxy messages as (I believe) they were not changed by the fs-encryption checkin. I can easily change those to debug also if that's desirable.

        Show
        Charles Lamb added a comment - Attached is a patch which changes the CryptoCodec and DFSClient messages from warn to debug. I considered changing the former to use the new PerformanceAdvisory log sink, but that still wouldn't suppress the messages per Allen's comment. wrt distcp, I did not change the tools.DistCp or client.RMProxy messages as (I believe) they were not changed by the fs-encryption checkin. I can easily change those to debug also if that's desirable.
        Hide
        Allen Wittenauer added a comment -

        distcp is even worse:

        $ bin/hadoop distcp /tmp /1
        14/08/27 07:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
        14/08/27 07:23:52 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
        14/08/27 07:23:52 INFO hdfs.DFSClient: No KeyProvider found.
        14/08/27 07:23:52 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[/tmp], targetPath=/1, targetPathExists=false, preserveRawXattrs=false}
        14/08/27 07:23:53 INFO client.RMProxy: Connecting to ResourceManager at aw-mbp-work.local/192.168.101.138:8032
        14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
        14/08/27 07:23:53 INFO hdfs.DFSClient: No KeyProvider found.
        14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
        14/08/27 07:23:53 INFO Configuration.deprecation: io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
        14/08/27 07:23:53 INFO Configuration.deprecation: io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
        14/08/27 07:23:53 INFO client.RMProxy: Connecting to ResourceManager at aw-mbp-work.local/192.168.101.138:8032
        14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
        14/08/27 07:23:53 INFO hdfs.DFSClient: No KeyProvider found.
        14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available.
        ...
        
        Show
        Allen Wittenauer added a comment - distcp is even worse: $ bin/hadoop distcp /tmp /1 14/08/27 07:23:52 WARN util.NativeCodeLoader: Unable to load native -hadoop library for your platform... using builtin-java classes where applicable 14/08/27 07:23:52 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available. 14/08/27 07:23:52 INFO hdfs.DFSClient: No KeyProvider found. 14/08/27 07:23:52 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit= false , syncFolder= false , deleteMissing= false , ignoreFailures= false , maxMaps=20, sslConfigurationFile=' null ', copyStrategy='uniformsize', sourceFileListing= null , sourcePaths=[/tmp], targetPath=/1, targetPathExists= false , preserveRawXattrs= false } 14/08/27 07:23:53 INFO client.RMProxy: Connecting to ResourceManager at aw-mbp-work.local/192.168.101.138:8032 14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available. 14/08/27 07:23:53 INFO hdfs.DFSClient: No KeyProvider found. 14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available. 14/08/27 07:23:53 INFO Configuration.deprecation: io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb 14/08/27 07:23:53 INFO Configuration.deprecation: io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor 14/08/27 07:23:53 INFO client.RMProxy: Connecting to ResourceManager at aw-mbp-work.local/192.168.101.138:8032 14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available. 14/08/27 07:23:53 INFO hdfs.DFSClient: No KeyProvider found. 14/08/27 07:23:53 WARN crypto.CryptoCodec: Crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec is not available. ...

          People

          • Assignee:
            Charles Lamb
            Reporter:
            Allen Wittenauer
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development