Version 0.23.0

RELEASED

Start date not set

Released: 11/Nov/11

Release Notes

PTKeySummaryAssigneeStatusDevelopment
BlockerBugHDFS-73DFSOutputStream does not close all the socketsUma Maheswara Rao GResolved1 commit
BlockerBugHDFS-1377Quota bug for partial blocks allows quotas to be violated Eli CollinsClosed4 commits
BlockerBugHDFS-1467Append pipeline never succeeds with more than one replicaTodd LipconClosed
BlockerBugHDFS-1505saveNamespace appears to succeed even if all directories fail to saveAaron T. MyersClosed
BlockerBugHDFS-151198 Release Audit warnings on trunk and branch-0.22Jakob HomanClosed
BlockerTestHDFS-1515Test append and quotas Eli CollinsResolved
BlockerBugHDFS-1524Image loader should make sure to read every byte in image fileHairong KuangClosed
BlockerBugHDFS-1576TestWriteConfigurationToDFS is timing out on trunkUnassignedResolved
BlockerBugHDFS-1585HDFS-1547 broke MR buildTodd LipconResolved
BlockerBugHDFS-1822Editlog opcodes overlap between 20 security and later releasesSuresh SrinivasClosed
BlockerBugHDFS-1823start-dfs.sh script fails if HADOOP_HOME is not setTom WhiteClosed
BlockerBugHDFS-1876One MiniDFSCluster ignores numDataNodes parameterTodd LipconClosed
BlockerBugHDFS-1919Upgrade to federated namespace failsSuresh SrinivasClosed
BlockerBugHDFS-1921Save namespace can cause NN to be unable to come up on restartMatt FoleyClosed
BlockerBugHDFS-1936Updating the layout version from HDFS-1822 causes upgrade problems.Suresh SrinivasClosed
BlockerBugHDFS-1943fail to start datanode while start-dfs.sh is executed by root userMatt FoleyClosed3 commits
BlockerBugHDFS-2229Deadlock in NameNodeTsz Wo Nicholas SzeClosed1 commit
BlockerBugHDFS-2232TestHDFSCLI fails on 0.22 branchPlamen JeliazkovClosed3 commits
BlockerBugHDFS-2289jsvc isn't part of the artifactAlejandro AbdelnurClosed2 commits
BlockerBugHDFS-2346TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methodsLaxmanClosed6 commits
BlockerBugHDFS-2412Add backwards-compatibility layer for FSConstantsTodd LipconClosed2 commits
CriticalBugHDFS-1898Tests failing on trunk due to use of NameNode.formatTodd LipconClosed
CriticalBugHDFS-2014bin/hdfs no longer works from a source checkoutEric YangClosed
CriticalBugHDFS-2240Possible deadlock between LeaseRenewer and its factoryTsz Wo Nicholas SzeClosed3 commits
CriticalBugHDFS-2361hftp is brokenJitendra Nath PandeyClosed4 commits
CriticalSub-taskHDFS-2395webhdfs api's should return a root element in the json responseTsz Wo Nicholas SzeClosed4 commits
CriticalBugHDFS-2414TestDFSRollback fails intermittentlyTodd LipconClosed2 commits
MajorBugHDFS-12"hadoop dfs -put" does not return nonzero status on failureUnassignedResolved
MajorImprovementHDFS-420Fuse-dfs should cache fs handlesBrian BockelmanResolved1 commit
MajorTestHDFS-780Revive TestFuseDFSEli CollinsResolved
MajorBugHDFS-863Potential deadlock in TestOverReplicatedBlocksKen GoodhopeResolved
MajorNew FeatureHDFS-1052HDFS scalability with multiple namenodesSuresh SrinivasResolved170 commits
MajorSub-taskHDFS-1070Speedup NameNode image loading and saving by storing local file namesHairong KuangResolved
MajorImprovementHDFS-1073Simpler model for Namenode's fs Image and edit Logs Todd LipconResolved49 commits
MajorImprovementHDFS-1117HDFS portion of HADOOP-6728 (ovehaul metrics framework)Luke LuResolved
MajorImprovementHDFS-1120Make DataNode's block-to-device placement policy pluggableHarsh JResolved
MajorBugHDFS-1149Lease reassignment is not persisted to edit logAaron T. MyersResolved
MajorBugHDFS-1189Quota counts missed between clear quota and set quotaJohn GeorgeClosed2 commits
MajorBugHDFS-1206TestFiHFlush fails intermittentlyKonstantin BoudnikClosed
MajorBugHDFS-1257Race condition on FSNamesystem#recentInvalidateSets introduced by HADOOP-5124Eric PayneClosed2 commits
MajorSub-taskHDFS-1295Improve namenode restart times by short-circuiting the first block reports from datanodesMatt FoleyResolved
MajorNew FeatureHDFS-1330Make RPCs to DataNodes timeoutJohn GeorgeClosed3 commits
MajorImprovementHDFS-1335HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNodeHairong KuangResolved
MajorBugHDFS-1371One bad node can incorrectly flag many files as corruptTanping WangResolved
MajorImprovementHDFS-1378Edit log replay should track and report file offsets in case of errorsColin P. McCabeClosed1 commit
MajorBugHDFS-1381HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parametersJim PlushResolved1 commit
MajorSub-taskHDFS-1398HDFS federation: Upgrade and rolling back of FederationUnassignedResolved
MajorImprovementHDFS-1442Api to get delegation token in HdfsJitendra Nath PandeyResolved
MajorSub-taskHDFS-1445Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per fileMatt FoleyClosed1 commit
MajorNew FeatureHDFS-1448Create multi-format parser for edits logs file, support binary and XML formats initiallyErik StefflResolved
MajorImprovementHDFS-1458Improve checkpoint performance by avoiding unnecessary image downloadsHairong KuangResolved
MajorBugHDFS-1463accessTime updates should not occur in safeModedhruba borthakurResolved
MajorSub-taskHDFS-1473Refactor storage management into separate classes than fsimage file reading/writingTodd LipconClosed
MajorImprovementHDFS-1476listCorruptFileBlocks should be functional while the name node is still in safe modePatrick KlingResolved2 commits
MajorBugHDFS-1480All replicas of a block can end up on the same rack when some datanodes are decommissioning.Todd LipconResolved1 commit
MajorImprovementHDFS-1481NameNode should validate fsimage before rollingHairong KuangResolved
MajorImprovementHDFS-1486Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing)Konstantin BoudnikResolved
MajorImprovementHDFS-1506Refactor fsimage loading codeHairong KuangResolved
MajorImprovementHDFS-1509Resync discarded directories in fs.name.dir during saveNamespace commanddhruba borthakurResolved
MajorBugHDFS-1516mvn-install is broken after 0.22 branch creationKonstantin BoudnikResolved
MajorBugHDFS-1523TestLargeBlock is failing on trunkKonstantin BoudnikClosed
MajorBugHDFS-1526Dfs client name for a map/reduce task should have some randomnessHairong KuangResolved
MajorBugHDFS-1533A more elegant FileSystem#listCorruptFileBlocks API (HDFS portion)Patrick KlingResolved2 commits
MajorImprovementHDFS-1536Improve HDFS WebUIHairong KuangResolved
MajorImprovementHDFS-1539prevent data loss when a cluster suffers a power lossdhruba borthakurClosed2 commits
MajorBugHDFS-1540Make Datanode handle errors to namenode.register call more elegantlydhruba borthakurResolved
MajorSub-taskHDFS-1541Not marking datanodes dead When namenode in safemodeHairong KuangClosed1 commit
MajorImprovementHDFS-1547Improve decommission mechanismSuresh SrinivasResolved
MajorBugHDFS-1551fix the pom template's versionGiridharan KesavanResolved
MajorSub-taskHDFS-1557Separate Storage from FSImageIvan KellyResolved
MajorImprovementHDFS-1582Remove auto-generated native build filesRoman ShaposhnikClosed
MajorImprovementHDFS-1583Improve backup-node sync performance by wrapping RPC parametersLiyin LiangResolved
MajorImprovementHDFS-1588Add dfs.hosts.exclude to DFSConfigKeys and use constant in stead of hardcoded stringErik StefflResolved
MajorBugHDFS-1592Datanode startup doesn't honor volumes.tolerated Bharath MundlapudiClosed2 commits
MajorBugHDFS-1594When the disk becomes full Namenode is getting shutdown and not able to recoverAaron T. MyersResolved
MajorImprovementHDFS-1596Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xmlHarsh JClosed
MajorBugHDFS-1598ListPathsServlet excludes .*.crc filesTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-1600editsStored.xml cause release audit warningTodd LipconResolved
MajorImprovementHDFS-1601Pipeline ACKs are sent as lots of tiny TCP packetsTodd LipconResolved1 commit
MajorBugHDFS-1602NameNode storage failed replica restoration is brokenBoris ShkolnikClosed
MajorNew FeatureHDFS-1606Provide a stronger data guarantee in the write pipelineTsz Wo Nicholas SzeResolved
MajorBugHDFS-1627Fix NullPointerException in Secondary NameNodeHairong KuangResolved
MajorSub-taskHDFS-1629Add a method to BlockPlacementPolicy for not removing the chosen nodesTsz Wo Nicholas SzeResolved
MajorImprovementHDFS-1630Checksum fseditsHairong KuangResolved
MajorBugHDFS-1656getDelegationToken in HftpFileSystem should renew TGT if needed.Jitendra Nath PandeyResolved1 commit
MajorSub-taskHDFS-1675Transfer RBW between datanodesTsz Wo Nicholas SzeClosed
MajorBugHDFS-1692In secure mode, Datanode process doesn't exit when disks fail.Bharath MundlapudiClosed2 commits
MajorBugHDFS-1734'Chunk size to view' option is not working in Name Node UI.Uma Maheswara Rao GClosed1 commit
MajorImprovementHDFS-1741Provide a minimal pom file to allow integration of HDFS into Sonar analysisKonstantin BoudnikClosed
MajorBugHDFS-1748Balancer utilization classification is incompleteTsz Wo Nicholas SzeClosed
MajorBugHDFS-1750fs -ls hftp://file not workingTsz Wo Nicholas SzeClosed1 commit
MajorNew FeatureHDFS-1751Intrinsic limits for HDFS files, directoriesDaryn SharpClosed
MajorImprovementHDFS-1757Don't compile fuse-dfs by defaultEli CollinsClosed
MajorBugHDFS-1760problems with getFullPathNameDaryn SharpClosed
MajorSub-taskHDFS-1761Add a new DataTransferProtocol operation, Op.TRANSFER_BLOCK, instead of using RPCTsz Wo Nicholas SzeClosed
MajorSub-taskHDFS-1767Namenode should ignore non-initial block reports from datanodes when in safemode during startupMatt FoleyClosed1 commit
MajorBugHDFS-1776Bug in Concat codeBharath MundlapudiClosed1 commit
MajorBugHDFS-1781jsvc executable delivered into wrong package...John GeorgeClosed
MajorBugHDFS-1782FSNamesystem.startFileInternal(..) throws NullPointerExceptionJohn GeorgeClosed
MajorImprovementHDFS-1785Cleanup BlockReceiver and DataXceiverTsz Wo Nicholas SzeClosed
MajorBugHDFS-1797New findbugs warning introduced by HDFS-1120Todd LipconClosed
MajorBugHDFS-1806TestBlockReport.blockReport_08() and _09() are timing-dependent and likely to fail on fast serversMatt FoleyClosed
MajorBugHDFS-1808TestBalancer waits forever, errs without giving informationMatt FoleyClosed
MajorImprovementHDFS-1810Remove duplicate jar entries from commonLuke LuClosed
MajorNew FeatureHDFS-1814HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalentAaron T. MyersClosed
MajorBugHDFS-1818TestHDFSCLI is failing on trunkAaron T. MyersClosed
MajorBugHDFS-1819TestDFSShell is failing on trunkAaron T. MyersClosed
MajorBugHDFS-1821FileContext.createSymlink with kerberos enabled sets wrong ownerJohn GeorgeClosed
MajorBugHDFS-1824delay instantiation of file system object until it is needed (linked to HADOOP-7207)Boris ShkolnikResolved
MajorSub-taskHDFS-1826NameNode should save image to name directories in parallel during upgradeMatt FoleyClosed1 commit
MajorBugHDFS-1827TestBlockReplacement waits forever, errs without giving informationMatt FoleyClosed
MajorSub-taskHDFS-1828TestBlocksWithNotEnoughRacks intermittently fails assertMatt FoleyClosed
MajorBugHDFS-1829TestNodeCount waits forever, errs without giving informationMatt FoleyClosed
MajorImprovementHDFS-1831HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinationsSuresh SrinivasClosed
MajorBugHDFS-1835DataNode.setNewStorageID pulls entropy from /dev/randomJohn CarrinoClosed
MajorImprovementHDFS-1840Terminate LeaseChecker when all writing files are closed.Tsz Wo Nicholas SzeClosed2 commits
MajorTestHDFS-1844Move -fs usage tests from hdfs into commonDaryn SharpClosed
MajorBugHDFS-1845symlink comes up as directory after namenode restartJohn GeorgeClosed
MajorImprovementHDFS-1846Don't fill preallocated portion of edits log with 0x00Aaron T. MyersClosed
MajorImprovementHDFS-1849Respect failed.volumes.tolerated on startupUnassignedClosed
MajorSub-taskHDFS-1854make failure message more useful in DFSTestUtil.waitReplication()Matt FoleyClosed
MajorTestHDFS-1855TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different waysMatt FoleyClosed
MajorSub-taskHDFS-1856TestDatanodeBlockScanner waits forever, errs without giving informationMatt FoleyClosed
MajorImprovementHDFS-1861Rename dfs.datanode.max.xcievers and bump its default valueEli CollinsClosed
MajorTestHDFS-1862Improve test reliability of HDFS-1594Aaron T. MyersClosed
MajorImprovementHDFS-1865Share LeaseChecker thread among DFSClientsTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-1869mkdirs should use the supplied permission for all of the created directoriesDaryn SharpClosed2 commits
MajorBugHDFS-1871Tests using MiniDFSCluster fail to compile due to HDFS-1052 changesSuresh SrinivasClosed
MajorNew FeatureHDFS-1873Federation Cluster Management Web ConsoleTanping WangClosed
MajorBugHDFS-1875MiniDFSCluster hard-codes dfs.datanode.address to localhostEric PayneClosed
MajorBugHDFS-1881Federation: after taking snapshot the current directory of datanode is emptyTanping WangClosed
MajorSub-taskHDFS-1883Recurring failures in TestBackupNode since HDFS-1052UnassignedClosed
MajorSub-taskHDFS-1884Improve TestDFSStorageStateRecoveryAaron T. MyersClosed
MajorBugHDFS-1888MiniDFSCluster#corruptBlockOnDatanodes() access must be public for MapReduce contrib raidSuresh SrinivasClosed
MajorBugHDFS-1889incorrect path in start/stop dfs scriptJohn GeorgeClosed
MajorImprovementHDFS-1899GenericTestUtils.formatNamenode is misplacedTed YuClosed
MajorTestHDFS-1902Fix path display for setrepDaryn SharpClosed
MajorTestHDFS-1903Fix path display for rm/rmrDaryn SharpClosed
MajorBugHDFS-1907BlockMissingException upon concurrent read and write: reader was doing file position read while writer is doing write without hflushJohn GeorgeClosed
MajorTestHDFS-1911HDFS tests for viewfsSanjay RadiaClosed
MajorTestHDFS-1912Update tests for FsShell standardized error messagesDaryn SharpClosed
MajorBugHDFS-1914Federation: namenode storage directory must be configurable specific to a namenodeSuresh SrinivasClosed
MajorBugHDFS-1917Clean up duplication of dependent jar filesEric YangClosed
MajorBugHDFS-1920libhdfs does not build for ARM processorsTrevor RobinsonClosed
MajorSub-taskHDFS-1922Recurring failure in TestJMXGet.testNameNode since build 477 on May 11Luke LuClosed
MajorSub-taskHDFS-1923Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29Tsz Wo Nicholas SzeClosed
MajorBugHDFS-1927audit logs could ignore certain xsactions and also could contain "ip=null"John GeorgeClosed
MajorTestHDFS-1928Fix path display for touchzDaryn SharpClosed
MajorTestHDFS-1931Update tests for du/dus/dfDaryn SharpClosed
MajorTestHDFS-1933Update tests for FsShell's "test"Daryn SharpClosed
MajorBugHDFS-1934Fix NullPointerException when File.listFiles() API returns nullBharath MundlapudiClosed2 commits
MajorImprovementHDFS-1937Umbrella JIRA for improving DataTransferProtocolTsz Wo Nicholas SzeResolved
MajorImprovementHDFS-1939ivy: test conf should not extend common confEric YangClosed
MajorSub-taskHDFS-1945Removed deprecated fields in DataTransferProtocolTsz Wo Nicholas SzeClosed
MajorBugHDFS-1952FSEditLog.open() appears to succeed even if all EDITS directories failAndrewClosed1 commit
MajorBugHDFS-1955FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826Matt FoleyClosed2 commits
MajorImprovementHDFS-1958Format confirmation prompt should be more lenient of its inputTodd LipconClosed
MajorNew FeatureHDFS-1963HDFS rpm integration projectEric YangClosed
MajorBugHDFS-1964Incorrect HTML unescaping in DatanodeJspHelper.javaAaron T. MyersClosed
MajorSub-taskHDFS-1966Encapsulate individual DataTransferProtocol op headerTsz Wo Nicholas SzeClosed
MajorTestHDFS-1983Fix path display for copy & rmDaryn SharpClosed
MajorImprovementHDFS-1996ivy: hdfs test jar should be independent to common test jarEric YangClosed
MajorBugHDFS-1999Tests use deprecated configsAaron T. MyersClosed
MajorBugHDFS-2002Incorrect computation of needed blocks in getTurnOffTip()Plamen JeliazkovClosed3 commits
MajorImprovementHDFS-2003Separate FSEditLog reading logic from editLog memory state building logicIvan KellyClosed
MajorBugHDFS-2011Removal and restoration of storage directories on checkpointing failure doesn't work properlyRavi PrakashClosed3 commits
MajorBugHDFS-2020TestDFSUpgradeFromImage failsSuresh SrinivasClosed
MajorBugHDFS-2021TestWriteRead failed with inconsistent visible length of a file John GeorgeClosed
MajorBugHDFS-2022ant binary should build libhdfsEric YangClosed
MajorBugHDFS-2041Some mtimes and atimes are lost when edit logs are replayedTodd LipconClosed
MajorImprovementHDFS-2046Force entropy to come from non-true random for testsTodd LipconClosed
MajorNew FeatureHDFS-2055Add hflush support to libhdfsTravis CrawfordClosed1 commit
MajorNew FeatureHDFS-2058DataTransfer Protocol using protobufsTodd LipconClosed
MajorBugHDFS-2065Fix NPE in DFSClient.getFileChecksumUma Maheswara Rao GClosed4 commits
MajorSub-taskHDFS-2066Create a package and individual class files for DataTransferProtocolTsz Wo Nicholas SzeClosed
MajorBugHDFS-2067Bump DATA_TRANSFER_VERSION in trunk for protobufsTsz Wo Nicholas SzeClosed
MajorBugHDFS-2072Remove StringUtils.stringifyException(ie) in logger functionsBharath MundlapudiClosed
MajorBugHDFS-2081trying to read configuration in hdfs write path might result in deadlockJohn GeorgeClosed
MajorBugHDFS-2082SecondaryNameNode web interface doesn't show the right infoAaron T. MyersClosed1 commit
MajorNew FeatureHDFS-2083Adopt JMXJsonServlet into HDFS in order to query statisticsTanping WangClosed1 commit
MajorBugHDFS-2086If the include hosts list contains host name, after restarting namenode, datanodes registrant is denied Tanping WangClosed1 commit
MajorSub-taskHDFS-2087Add methods to DataTransferProtocol interfaceTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-2092Create a light inner conf class in DFSClientBharath MundlapudiClosed1 commit
MajorTaskHDFS-2096Mavenization of hadoop-hdfsAlejandro AbdelnurClosed1 commit
MajorBugHDFS-2103Read lock must be released before acquiring a write lockBharath MundlapudiClosed
MajorSub-taskHDFS-2107Move block management code to a packageTsz Wo Nicholas SzeClosed4 commits
MajorSub-taskHDFS-2108Move datanode heartbeat handling to BlockManagerTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-2109Store uMask as member variable to DFSClient.ConfBharath MundlapudiClosed1 commit
MajorTestHDFS-2111Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)Harsh JClosed1 commit
MajorSub-taskHDFS-2112Move ReplicationMonitor to block managementUma Maheswara Rao GClosed1 commit
MajorBugHDFS-2114re-commission of a decommissioned node does not delete excess replicaJohn GeorgeClosed1 commit
MajorTestHDFS-2131Tests for HADOOP-7361Uma Maheswara Rao GClosed1 commit
MajorBugHDFS-2132Potential resource leak in EditLogFileOutputStream.closeAaron T. MyersClosed1 commit
MajorSub-taskHDFS-2134Move DecommissionManager to block managementTsz Wo Nicholas SzeClosed1 commit
MajorSub-taskHDFS-2140Move Host2NodesMap to block managementTsz Wo Nicholas SzeClosed1 commit
MajorSub-taskHDFS-2141Remove NameNode roles Active and Standby (they become states)Suresh SrinivasClosed1 commit
MajorImprovementHDFS-2143Federation: we should link to the live nodes and dead nodes to cluster web consoleRavi PrakashClosed1 commit
MajorImprovementHDFS-2144If SNN shuts down during initialization it does not log the causeRavi PrakashClosed1 commit
MajorSub-taskHDFS-2147Move cluster network topology to block managementTsz Wo Nicholas SzeClosed1 commit
MajorSub-taskHDFS-2149Move EditLogOp serialization formats into FsEditLogOp implementationsIvan KellyClosed2 commits
1200 of 379