Version 2.6.0

RELEASED

Start date not set

Released: 18/Nov/14

Release Notes

2.6.0 releaseShow more
1–200 of 310View in Issue Navigator
PTKeySummaryAssigneeStatus
BlockerBugHDFS-6905fs-encryption merge triggered release audit failuresCharles LambClosed
BlockerBugHDFS-7042Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.Chris NaurothClosed
BlockerBugHDFS-7122Use of ThreadLocal<Random> results in poor block placementAndrew WangClosed
BlockerBugHDFS-7147Update archival storage user documentationTsz-wo SzeClosed
BlockerBugHDFS-7274Disable SSLv3 in HttpFSRobert KanterClosed
BlockerBugHDFS-7288HDFS compiling failure on trunkUnassignedClosed
BlockerBugHDFS-7385ThreadLocal used in FSEditLog class causes FSImage permission mess upjiangyuClosed
BlockerBugHDFS-7391Renable SSLv2Hello in HttpFSRobert KanterClosed
BlockerBugHDFS-16098ERROR tools.DiskBalancerCLI: java.lang.IllegalArgumentExceptionUnassignedOpen
CriticalBugHDFS-5185DN fails to startup if one of the data dir is fullVinayakumar BClosed
CriticalBugHDFS-5809BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loopColin McCabeClosed
CriticalBugHDFS-6114Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.currVinayakumar BClosed
CriticalBugHDFS-6840Clients are always sent to the same datanode when read is off rackAndrew WangClosed
CriticalImprovementHDFS-6871Improve NameNode performance when creating file Yi LiuClosed
CriticalImprovementHDFS-6886Use single editlog record for creating file + overwrite.Yi LiuClosed
CriticalBugHDFS-6904YARN unable to renew delegation token fetched via webhdfs due to incorrect service portJitendra Nath PandeyClosed
CriticalBugHDFS-6908incorrect snapshot directory diff generated by snapshot deletionJuan YuClosed
CriticalBugHDFS-7005DFS input streams do not timeoutDaryn SharpClosed
CriticalBugHDFS-7045Fix NameNode deadlock when opening file under /.reserved pathYi LiuClosed
CriticalBugHDFS-7046HA NN can NPE upon transition to activeKihwal LeeClosed
CriticalBugHDFS-7065Pipeline close recovery race can cause block corruptionKihwal LeeClosed
CriticalSub-taskHDFS-7179DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtensionAndrew WangClosed
CriticalBugHDFS-7180NFSv3 gateway frequently gets stuck due to GCBrandon LiClosed
CriticalSub-taskHDFS-7181Remove incorrect precondition check on key length in FileEncryptionInfoAndrew WangClosed
CriticalBugHDFS-7199DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exceptionRushabh ShahClosed
CriticalBugHDFS-7300The getMaxNodesPerRack() method in BlockPlacementPolicyDefault is flawedKihwal LeeClosed
CriticalBugHDFS-7387NFS may only do partial commit due to a race between COMMIT and writeBrandon LiClosed
MajorImprovementHDFS-573Porting libhdfs to WindowsChris NaurothClosed
MajorImprovementHDFS-2856Fix block protocol so that Datanodes don't require root or jsvcChris NaurothClosed
MajorBugHDFS-2975Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).Yi LiuClosed
MajorImprovementHDFS-3528Use native CRC32 in DFS write pathJames ThomasClosed
MajorBugHDFS-3988HttpFS can't do GETDELEGATIONTOKEN without a prior authenticated requestAlejandro AbdelnurClosed
MajorBugHDFS-4227Document dfs.namenode.resource.* Daisuke KobayashiClosed
MajorBugHDFS-4629Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVAUnassignedClosed
MajorBugHDFS-5089When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.Tsz-wo SzeClosed
MajorImprovementHDFS-5098Enhance FileSystem.Statistics to have locality informationSuresh SrinivasClosed
MajorImprovementHDFS-5182BlockReaderLocal must allow zero-copy reads only when the DN believes it's validColin McCabeClosed
MajorImprovementHDFS-5202Support Centralized Cache Management on Windows.Chris NaurothClosed
MajorTestHDFS-5624Add HDFS tests for ACLs in combination with viewfs.Stephen ChuClosed
MajorBugHDFS-5723Append failed FINALIZED replica should not be accepted as valid when that block is underconstructionVinayakumar BClosed
MajorImprovementHDFS-5801HDFS rack-awareness for nodes outside of the clusterUnassignedClosed
MajorBugHDFS-5919FileJournalManager doesn't purge empty and corrupt inprogress edits filesVinayakumar BClosed
MajorSub-taskHDFS-6036Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too longColin McCabeClosed
MajorNew FeatureHDFS-6134Transparent data at rest encryptionCharles LambClosed
MajorImprovementHDFS-6188An ip whitelist based implementation of TrustedChannelResolverBenoy AntonyClosed
MajorBugHDFS-6247Avoid timeouts for replaceBlock() call by sending intermediate responses to BalancerVinayakumar BClosed
MajorBugHDFS-6376Distcp data between two HA clusters requires another configurationDave MarionClosed
MajorSub-taskHDFS-6385Show when block deletion will start after NameNode startup in WebUIChris NaurothClosed
MajorImprovementHDFS-6441Add ability to exclude/include specific datanodes while balancingBenoy AntonyClosed
MajorBugHDFS-6451NFS should not return NFS3ERR_IO for AccessControlException Abhiraj ButalaClosed
MajorBugHDFS-6455NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hostsAbhiraj ButalaClosed
MajorBugHDFS-6456NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hostsAbhiraj ButalaClosed
MajorBugHDFS-6478RemoteException can't be retried properly for non-HA scenarioMing MaClosed
MajorImprovementHDFS-6482Use block ID-based block layout on datanodesJames ThomasClosed
MajorBugHDFS-6506Newly moved block replica been invalidated and deleted in TestBalancerBinglin ChangClosed
MajorBugHDFS-6517Remove hadoop-metrics2.properties from hdfs projectAkira AjisakaClosed
MajorImprovementHDFS-6519Document oiv_legacy commandAkira AjisakaClosed
MajorBugHDFS-6567Normalize the order of public final in HdfsFileStatusTassapol AthiapinyaClosed
MajorBugHDFS-6569OOB message can't be sent to the client when DataNode shuts down for upgradeBrandon LiClosed
MajorImprovementHDFS-6570add api that enables checking if a user has certain permissions on a fileJitendra Nath PandeyClosed
MajorNew FeatureHDFS-6581Write to single replica in memoryArpit AgarwalClosed
MajorNew FeatureHDFS-6584Support Archival StorageTsz-wo SzeClosed
MajorImprovementHDFS-6597Add a new option to NN upgrade to terminate the process after upgrade on NN is completedDanilo VunjakClosed
MajorImprovementHDFS-6606Optimize HDFS Encrypted Transport performanceYi LiuClosed
MajorSub-taskHDFS-6609Use DirectorySnapshottableFeature to represent a snapshottable directoryJing ZhaoClosed
MajorBugHDFS-6621Hadoop Balancer prematurely exits iterationsRafal WojdylaClosed
MajorImprovementHDFS-6627Rename DataNode#checkWriteAccess to checkReadAccess.Liang XieClosed
MajorBugHDFS-6630Unable to fetch the block information by Browsing the file system on Namenode UI through IE9Haohui MaiClosed
MajorNew FeatureHDFS-6634inotify in HDFSJames ThomasClosed
MajorTestHDFS-6638shorten test run time with a smaller retry timeout settingLiang XieClosed
MajorBugHDFS-6640[ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).Stephen ChuClosed
MajorBugHDFS-6646[ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missedBrahma Reddy BattulaClosed
MajorImprovementHDFS-6655Add 'header banner' to 'explorer.html' also in Namenode UIVinayakumar BClosed
MajorTestHDFS-6665Add tests for XAttrs in combination with viewfsStephen ChuClosed
MajorBugHDFS-6667In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] errorJing ZhaoClosed
MajorImprovementHDFS-6685Balancer should preserve storage type of replicasTsz-wo SzeClosed
MajorBugHDFS-6689NFS doesn't return correct lookup access for directoriesBrandon LiClosed
MajorImprovementHDFS-6690Deduplicate xattr names in memoryAndrew WangClosed
MajorBugHDFS-6693TestDFSAdminWithHA fails on windowsVinayakumar BClosed
MajorImprovementHDFS-6701Make seed optional in NetworkTopology#sortByDistanceAshwin ShankarClosed
MajorBugHDFS-6702DFSClient should create blocks using StorageType Tsz-wo SzeClosed
MajorSub-taskHDFS-6705Create an XAttr that disallows the HDFS admin from accessing a fileCharles LambClosed
MajorBugHDFS-6715webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup modeJing ZhaoClosed
MajorSub-taskHDFS-6722Display readable last contact time for dead nodes on NN webUIMing MaClosed
MajorSub-taskHDFS-6727Refresh data volumes on DataNode based on configuration changesLei (Eddy) XuClosed
MajorSub-taskHDFS-6728Dynamically add new volumes to DataStorage, formatted if necessary.Lei (Eddy) XuClosed
MajorBugHDFS-6731Run "hdfs zkfc-formatZK" on a server in a non-namenode will cause a null pointer exception.Masatake IwasakiClosed
MajorImprovementHDFS-6739Add getDatanodeStorageReport to ClientProtocolTsz-wo SzeClosed
MajorSub-taskHDFS-6740Make FSDataset support adding data volumes dynamicallyLei (Eddy) XuClosed
MajorBugHDFS-6749FSNamesystem methods should call resolvePathCharles LambClosed
MajorSub-taskHDFS-6750The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as staleColin McCabeClosed
MajorBugHDFS-6754TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retryMit DesaiClosed
MajorImprovementHDFS-6755There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenodeMit DesaiClosed
MajorImprovementHDFS-6758block writer should pass the expected block size to DataXceiverServerArpit AgarwalClosed
MajorBugHDFS-6768Fix a few unit tests that use hard-coded port numbersArpit AgarwalClosed
MajorImprovementHDFS-6772Get DN storages out of blockContentsStale state faster after NN restartsMing MaClosed
MajorImprovementHDFS-6773MiniDFSCluster should skip edit log fsync by defaultStephen ChuClosed
MajorSub-taskHDFS-6774Make FsDataset and DataStore support removing volumes.Lei (Eddy) XuClosed
MajorBugHDFS-6776Using distcp to copy data between insecure and secure cluster via webdhfs doesn't workYongjun ZhangClosed
MajorSub-taskHDFS-6777Supporting consistent edit log reads when in-progress edit log segments are includedJames ThomasClosed
MajorBugHDFS-6778The extended attributes javadoc should simply refer to the user docsCharles LambClosed
MajorImprovementHDFS-6781Separate HDFS commands from CommandsManual.apt.vmAkira AjisakaClosed
MajorBugHDFS-6783Fix HDFS CacheReplicationMonitor rescan logicYi LiuClosed
MajorBugHDFS-6787Remove duplicate code in FSDirectory#unprotectedConcatYi LiuClosed
MajorBugHDFS-6788Improve synchronization in BPOfferService with read write lockYongjun ZhangClosed
MajorBugHDFS-6789TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7Akira AjisakaClosed
MajorBugHDFS-6790DFSUtil Should Use configuration.getPassword for SSL passwordsLarry McCayClosed
MajorBugHDFS-6791A block could remain under replicated if all of its replicas are on decommissioned nodesMing MaClosed
MajorBugHDFS-6797DataNode logs wrong layoutversion during upgradeBenoy AntonyClosed
MajorImprovementHDFS-6798Add test case for incorrect data node condition during balancingBenoy AntonyClosed
MajorImprovementHDFS-6800Support Datanode layout changes with rolling upgradeJames ThomasClosed
MajorBugHDFS-6802Some tests in TestDFSClientFailover are missing @Test annotationAkira AjisakaClosed
MajorSub-taskHDFS-6808Add command line option to ask DataNode reload configuration.Lei (Eddy) XuClosed
MajorBugHDFS-6825Edit log corruption due to delayed block removalYongjun ZhangClosed
MajorImprovementHDFS-6828Separate block replica dispatching from BalancerTsz-wo SzeClosed
MajorBugHDFS-6830BlockInfo.addStorage fails when DN changes the storage for a block replicaArpit AgarwalClosed
MajorImprovementHDFS-6836HDFS INFO logging is verbose & uses file appendersNathan YaoClosed
MajorSub-taskHDFS-6843Create FileStatus isEncrypted() methodCharles LambClosed
MajorImprovementHDFS-6849Replace HttpFS custom proxyuser handling with common implementationAlejandro AbdelnurClosed
MajorSub-taskHDFS-6851Refactor EncryptionZoneWithId and EncryptionZoneCharles LambClosed
MajorBugHDFS-6862Add missing timeout annotations to testsXiaoyu YaoClosed
MajorSub-taskHDFS-6865Byte array native checksumming on client side (HDFS changes)James ThomasClosed
MajorBugHDFS-6868portmap and nfs3 are documented as hadoop commands instead of hdfsBrandon LiClosed
MajorBugHDFS-6870Blocks and INodes could leak for Rename with overwrite flagYi LiuClosed
MajorSub-taskHDFS-6879Adding tracing to Hadoop RPCMasatake IwasakiClosed
MajorSub-taskHDFS-6880Adding tracing to DataNode data transfer protocolMasatake IwasakiClosed
MajorBugHDFS-6890NFS readdirplus doesn't return dotdot attributesBrandon LiClosed
MajorSub-taskHDFS-6892Add XDR packaging method for each NFS requestBrandon LiClosed
MajorSub-taskHDFS-6894Add XDR parser method for each NFS responseBrandon LiClosed
MajorBugHDFS-6898DN must reserve space for a full block when an RBW block is createdArpit AgarwalClosed
MajorImprovementHDFS-6899Allow changing MiniDFSCluster volumes per DN and capacity per volumeArpit AgarwalClosed
MajorSub-taskHDFS-6921Add LazyPersist flag to FileStatusArpit AgarwalClosed
MajorSub-taskHDFS-6923Propagate LazyPersist flag to DNs via DataTransferProtocolArpit AgarwalClosed
MajorSub-taskHDFS-6924Add new RAM_DISK storage typeArpit AgarwalClosed
MajorSub-taskHDFS-6925DataNode should attempt to place replicas on transient storage first if lazyPersist flag is receivedArpit AgarwalClosed
MajorSub-taskHDFS-6926DN support for saving replicas to persistent storage and evicting in-memory replicasArpit AgarwalClosed
MajorSub-taskHDFS-6927Add unit testsArpit AgarwalClosed
MajorSub-taskHDFS-6928'hdfs put' command should accept lazyPersist flag for testingArpit AgarwalClosed
MajorSub-taskHDFS-6929NN periodically unlinks lazy persist files with missing replicas from namespaceArpit AgarwalClosed
MajorSub-taskHDFS-6930Improve replica eviction from RAM diskArpit AgarwalClosed
MajorSub-taskHDFS-6931Move lazily persisted replicas to finalized directory on DN startupArpit AgarwalClosed
MajorSub-taskHDFS-6932Balancer and Mover tools should ignore replicas on RAM_DISKXiaoyu YaoClosed
MajorSub-taskHDFS-6934Move checksum computation off the hot path when writing to RAM diskChris NaurothClosed
MajorBugHDFS-6948DN rejects blocks if it has older UC blockEric PayneClosed
MajorSub-taskHDFS-6950Add Additional unit tests for HDFS-6581Xiaoyu YaoClosed
MajorSub-taskHDFS-6951Correctly persist raw namespace xattrs to edit log and fsimageCharles LambClosed
MajorBugHDFS-6954With crypto, no native lib systems are too verboseCharles LambClosed
MajorSub-taskHDFS-6956Allow dynamically changing the tracing level in Hadoop serversColin McCabeClosed
MajorSub-taskHDFS-6960Bugfix in LazyWriter, fix test case and some refactoringArpit AgarwalClosed
MajorBugHDFS-6965NN continues to issue block locations for DNs with full disksRushabh ShahClosed
MajorSub-taskHDFS-6966Add additional unit tests for encryption zonesStephen ChuClosed
MajorSub-taskHDFS-6970Move startFile EDEK retries to the DFSClientAndrew WangClosed
MajorBugHDFS-6972TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctlyYongjun ZhangClosed
MajorSub-taskHDFS-6977Delete all copies when a block is deleted from the block spaceArpit AgarwalClosed
MajorSub-taskHDFS-6978Directory scanner should correctly reconcile blocks on RAM diskArpit AgarwalClosed
MajorBugHDFS-6981Fix DN upgrade with layout version changeArpit AgarwalClosed
MajorSub-taskHDFS-6986DistributedFileSystem must get delegation tokens from configured KeyProviderZhe ZhangClosed
MajorSub-taskHDFS-6987Move CipherSuite xattr information up to the encryption zone rootZhe ZhangClosed
MajorSub-taskHDFS-6988Improve HDFS-6581 eviction configurationXiaoyu YaoClosed
MajorSub-taskHDFS-6990Add unit test for evict/delete RAM_DISK block with open handleXiaoyu YaoClosed
MajorSub-taskHDFS-6991Notify NN of evicted block before deleting it from RAM diskArpit AgarwalClosed
MajorBugHDFS-6995Block should be placed in the client's 'rack-local' node if 'client-local' node is not availableVinayakumar BClosed
MajorBugHDFS-6996SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/fileJing ZhaoClosed
MajorSub-taskHDFS-7003Add NFS Gateway support for reading and writing to encryption zonesCharles LambClosed
MajorSub-taskHDFS-7004Update KeyProvider instantiation to create by URIAndrew WangClosed
MajorTestHDFS-7006Test encryption zones with KMSAlejandro AbdelnurClosed
MajorTestHDFS-7025HDFS Credential Provider related Unit Test FailureXiaoyu YaoClosed
MajorSub-taskHDFS-7032Add WebHDFS support for reading and writing to encryption zonesCharles LambClosed
MajorSub-taskHDFS-7047Expose FileStatus#isEncrypted in libhdfsColin McCabeClosed
MajorSub-taskHDFS-7064Fix unit test failures in HDFS-6581 branchXiaoyu YaoClosed
MajorBugHDFS-7073Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases.Chris NaurothClosed
MajorBugHDFS-7075hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$FactoryColin McCabeClosed
MajorSub-taskHDFS-7077Separate CipherSuite from crypto protocol versionAndrew WangClosed
MajorSub-taskHDFS-7078Fix listEZs to work correctly with snapshotsAndrew WangClosed
MajorSub-taskHDFS-7079Few more unit test fixes for HDFS-6581Arpit AgarwalClosed
MajorSub-taskHDFS-7080Fix finalize and upgrade unit test failuresArpit AgarwalClosed
MajorSub-taskHDFS-7081Add new DistributedFileSystem API for getting all the existing storage policiesJing ZhaoClosed
MajorSub-taskHDFS-7090Use unbuffered writes when persisting in-memory replicasXiaoyu YaoClosed
MajorImprovementHDFS-7093Add config key to restrict setStoragePolicyArpit AgarwalClosed
MajorSub-taskHDFS-7100Make eviction scheme pluggableArpit AgarwalClosed
MajorBugHDFS-7106Reconfiguring DataNode volumes does not release the lock files in removed volumes.Chris NaurothClosed
MajorSub-taskHDFS-7108Fix unit test failures in SimulatedFsDatasetArpit AgarwalClosed
MajorSub-taskHDFS-7112LazyWriter should use either async IO or one thread per physical diskXiaoyu YaoClosed
MajorTestHDFS-7115TestEncryptionZones assumes Unix path separator for KMS key store pathXiaoyu YaoClosed
MajorSub-taskHDFS-7118Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.Chris NaurothClosed
MajorBugHDFS-7127TestLeaseRecovery leaks MiniDFSCluster instances.Chris NaurothClosed
MajorImprovementHDFS-7128Decommission slows way down when it gets towards the endMing MaClosed
MajorSub-taskHDFS-7129Metrics to track usage of memory for writesXiaoyu YaoClosed
MajorBugHDFS-7130TestDataTransferKeepalive fails intermittently on Windows.Chris NaurothClosed
MajorBugHDFS-7131During HA upgrade, JournalNode should create a new committedTxnId file in the current directoryJing ZhaoClosed
MajorSub-taskHDFS-7138Fix hftp to work with encryptionCharles LambClosed
MajorSub-taskHDFS-7143Fix findbugs warnings in HDFS-6581 branchTsz-wo SzeClosed
MajorBugHDFS-7148TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage mergeAndrew WangClosed
MajorImprovementHDFS-7153Add storagePolicy to NN edit log during file creationArpit AgarwalClosed
MajorSub-taskHDFS-7154Fix returning value of starting reconfiguration taskLei (Eddy) XuClosed
MajorSub-taskHDFS-7155Bugfix in createLocatedFileStatus caused by bad mergeArpit AgarwalClosed
MajorBugHDFS-7156Fsck documentation is outdated.Masahiro YamaguchiClosed
MajorSub-taskHDFS-7157Using Time.now() for recording start/end time of reconfiguration tasksLei (Eddy) XuClosed
MajorImprovementHDFS-7158Reduce the memory usage of WebImageViewerHaohui MaiClosed
MajorSub-taskHDFS-7159Use block storage policy to set lazy persist preferenceArpit AgarwalClosed
1–200 of 310