Version 0.22.0

RELEASED

Start date not set

Released: 10/Dec/11

Release Notes

PTKeySummaryAssigneeStatusDevelopment
BlockerBugHDFS-671Documentation change for updated configuration keys.Tom WhiteClosed
BlockerBugHDFS-727bug setting block size hdfsOpenFile Eli CollinsClosed2 commits
BlockerBugHDFS-875NameNode incorretly handles corrupt replicasUnassignedResolved
BlockerBugHDFS-900Corrupt replicas are not tracked correctly through block report from DNKonstantin ShvachkoClosed
BlockerBugHDFS-939libhdfs test is brokenEli CollinsClosed1 commit
BlockerBugHDFS-940libhdfs uses UnixUserGroupInformationUnassignedClosed
BlockerTestHDFS-981test-contrib fails due to test-cactus failureKonstantin BoudnikClosed
BlockerTestHDFS-982TestDelegationToken#testDelegationTokenWithRealUser is failingPo CheungClosed
BlockerBugHDFS-988saveNamespace race can corrupt the edits logEli CollinsClosed1 commit
BlockerBugHDFS-990FSNameSystem#renewDelegationToken doesn't compileUnassignedResolved
BlockerSub-taskHDFS-1057Concurrent readers hit ChecksumExceptions if following a writer to very end of filesam rashClosed2 commits
BlockerBugHDFS-1084TestDFSShell fails in trunk.Po CheungResolved
BlockerBugHDFS-1141completeFile does not check lease ownershipTodd LipconClosed2 commits
BlockerBugHDFS-1165createSymlink should not hold the fsnamesytem lock when sync its edit log to diskEli CollinsClosed
BlockerBugHDFS-1258Clearing namespace quota on "/" corrupts FS imageAaron T. MyersClosed4 commits
BlockerTestHDFS-1373Some tests fails on hosts w/o kerberos installedPo CheungResolved
BlockerTestHDFS-1376TestFileCreation times outPo CheungResolved
BlockerBugHDFS-1377Quota bug for partial blocks allows quotas to be violated Eli CollinsClosed4 commits
BlockerBugHDFS-1467Append pipeline never succeeds with more than one replicaTodd LipconClosed
BlockerBugHDFS-1496TestStorageRestore is failing after HDFS-903 fixHairong KuangResolved
BlockerBugHDFS-1505saveNamespace appears to succeed even if all directories fail to saveAaron T. MyersClosed
BlockerBugHDFS-151198 Release Audit warnings on trunk and branch-0.22Jakob HomanClosed
BlockerTestHDFS-1515Test append and quotas Eli CollinsResolved
BlockerBugHDFS-1524Image loader should make sure to read every byte in image fileHairong KuangClosed
BlockerBugHDFS-1529Incorrect handling of interrupts in waitForAckedSeqno can cause deadlockTodd LipconClosed
BlockerBugHDFS-1550NPE when listing a file with no locationHairong KuangClosed
BlockerBugHDFS-1561BackupNode listens on default hostKonstantin ShvachkoClosed
BlockerBugHDFS-1572Checkpointer should trigger checkpoint with specified period.Jakob HomanClosed
BlockerBugHDFS-1575viewing block from web UI brokenAaron T. MyersClosed
BlockerBugHDFS-1576TestWriteConfigurationToDFS is timing out on trunkUnassignedResolved
BlockerBugHDFS-1597Batched edit log syncs can reset synctxid throw assertionsTodd LipconClosed
BlockerBugHDFS-1666TestAuthorizationFilter is failingTodd LipconResolved
BlockerBugHDFS-1822Editlog opcodes overlap between 20 security and later releasesSuresh SrinivasClosed
BlockerBugHDFS-1823start-dfs.sh script fails if HADOOP_HOME is not setTom WhiteClosed
BlockerBugHDFS-1921Save namespace can cause NN to be unable to come up on restartMatt FoleyClosed
BlockerBugHDFS-1936Updating the layout version from HDFS-1822 causes upgrade problems.Suresh SrinivasClosed
BlockerBugHDFS-1943fail to start datanode while start-dfs.sh is executed by root userMatt FoleyClosed3 commits
BlockerSub-taskHDFS-1967TestHDFSTrash failing on trunk and 22UnassignedResolved
BlockerBugHDFS-1969Running rollback on new-version namenode destroys namespaceTodd LipconClosed
BlockerBugHDFS-1981When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failingUma Maheswara Rao GClosed2 commits
BlockerBugHDFS-2012Recurring failure of TestBalancer due to incorrect treatment of nodes whose utilization equals avgUtilization.Uma Maheswara Rao GClosed2 commits
BlockerBugHDFS-2189guava-r09 dependency missing from "ivy/hadoop-hdfs-template.xml" in HDFS.Joep RottinghuisClosed4 commits
BlockerBugHDFS-2211Build does not pass along properties to contrib buildsJoep RottinghuisClosed1 commit
BlockerBugHDFS-2232TestHDFSCLI fails on 0.22 branchPlamen JeliazkovClosed3 commits
BlockerBugHDFS-2297FindBugs OutOfMemoryErrorJoep RottinghuisClosed1 commit
BlockerBugHDFS-2315Build fails with ant 1.7.0 but works with 1.8.0Joep RottinghuisClosed1 commit
BlockerBugHDFS-2341Contribs not buildingJoep RottinghuisClosed3 commits
BlockerBugHDFS-2343Make hdfs use same version of avro as HBaseJoep RottinghuisClosed1 commit
BlockerBugHDFS-2346TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methodsLaxmanClosed6 commits
BlockerBugHDFS-2377hdfs script reporting Unrecognized option: -jvmUnassignedResolved
BlockerBugHDFS-2383TestDfsOverAvroRpc is failing on 0.22Konstantin ShvachkoClosed1 commit
CriticalBugHDFS-903NN should verify images and edit logs on startupHairong KuangClosed
CriticalBugHDFS-970FSImage writing should always fsync before closeTodd LipconClosed1 commit
CriticalBugHDFS-1542Deadlock in Configuration.writeXml when serialized form is larger than one DFS blockTodd LipconClosed2 commits
CriticalBugHDFS-1932Ensure that HDFS configuration deprecations are set up in every spot that HDFS configurations are loaded.Jolly ChenClosed
CriticalBugHDFS-1965IPCs done using block token-based tickets can't reuse connectionsTodd LipconClosed
MajorBugHDFS-96HDFS does not support blocks greater than 2GBPatrick KlingClosed2 commits
MajorNew FeatureHDFS-202Add a bulk FIleSystem.getFileBlockLocationsHairong KuangClosed1 commit
MajorSub-taskHDFS-259Remove intentionally corrupt 0.13 directory layout creationTodd LipconClosed
MajorTestHDFS-523Create performance/scalability tests for append featureUnassignedResolved
MajorNew FeatureHDFS-528Add ability for safemode to wait for a minimum number of live datanodesTodd LipconClosed2 commits
MajorImprovementHDFS-556Provide info on failed volumes in the web uiEli CollinsClosed
MajorImprovementHDFS-599Improve Namenode robustness by prioritizing datanode heartbeats over client requestsDmytro MolkovClosed2 commits
MajorBugHDFS-613TestBalancer and TestBlockTokenWithDFS fail Balancer assertTodd LipconClosed
MajorTestHDFS-696Java assertion failures triggered by testsEli CollinsClosed
MajorTestHDFS-697Enable asserts for tests by defaultEli CollinsClosed
MajorNew FeatureHDFS-708A stress-test tool for HDFS.Joshua HarlowClosed
MajorTaskHDFS-712Move libhdfs from mr to hdfs Eli CollinsClosed1 commit
MajorNew FeatureHDFS-752Add interface classification stable & scope to HDFSSuresh SrinivasClosed1 commit
MajorBugHDFS-810Number of Under-Replicated Blocks information posted on WebUI is inconsistent with CLI Fsck report. UnassignedResolved
MajorBugHDFS-829hdfsJniHelper.c: #include <error.h> is not portableAllen WittenauerClosed
MajorImprovementHDFS-853The HDFS webUI should show a metric that summarizes whether the cluster is balanced regarding disk space usageDmytro MolkovClosed1 commit
MajorBugHDFS-874TestHDFSFileContextMainOperations fails on weirdly configured DNS hostsTodd LipconClosed
MajorImprovementHDFS-881Refactor DataNode Packet header into DataTransferProtocolTodd LipconClosed
MajorImprovementHDFS-895Allow hflush/sync to occur in parallel with new writes to the fileTodd LipconClosed4 commits
MajorImprovementHDFS-941Datanode xceiver protocol should allow reuse of a connectionbc WongClosed2 commits
MajorImprovementHDFS-947The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicasDmytro MolkovClosed1 commit
MajorImprovementHDFS-974FileSystem.Statistics should include NN accesses from the clientsSuresh SrinivasResolved
MajorNew FeatureHDFS-992Re-factor block access token implementation to conform to the generic Token interface in CommonKan ZhangClosed3 commits
MajorNew FeatureHDFS-1003authorization checks for inter-server protocol (based on HADOOP-6600)Boris ShkolnikClosed3 commits
MajorNew FeatureHDFS-1004Update NN to support Kerberized SSL from HADOOP-6584Jakob HomanClosed1 commit
MajorNew FeatureHDFS-1005Fsck securityBoris ShkolnikClosed5 commits
MajorBugHDFS-1006getImage/putImage http requests should be https for the case of security enabled.Boris ShkolnikClosed3 commits
MajorBugHDFS-1007HFTP needs to be updated to use delegation tokensDevaraj DasClosed8 commits
MajorBugHDFS-1017browsedfs jsp should call JspHelper.getUGI rather than using createRemoteUser()Jakob HomanClosed2 commits
MajorBugHDFS-1019Incorrect default values for delegation tokens in hdfs-default.xmlJitendra Nath PandeyClosed2 commits
MajorBugHDFS-1021specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in DFSAdmin (for HADOOP-6612)Boris ShkolnikClosed1 commit
MajorImprovementHDFS-1023Allow http server to start as regular principal if https principal not defined.Jakob HomanClosed4 commits
MajorImprovementHDFS-1033In secure clusters, NN and SNN should verify that the remote principal during image and edits transferJakob HomanClosed2 commits
MajorImprovementHDFS-1035Generate Eclipse's .classpath file from Ivy configNigel DaleyClosed
MajorBugHDFS-1036in DelegationTokenFetch dfs.getURI returns no portBoris ShkolnikClosed5 commits
MajorBugHDFS-1038In nn_browsedfscontent.jsp fetch delegation token only if security is enabled.Jitendra Nath PandeyClosed4 commits
MajorBugHDFS-1039Service should be set in the token in JspHelper.getUGIJitendra Nath PandeyClosed4 commits
MajorBugHDFS-1044Cannot submit mapreduce job from secure client to unsecure severBoris ShkolnikClosed3 commits
MajorBugHDFS-1045In secure clusters, re-login is necessary for https clients before opening connectionsJakob HomanClosed2 commits
MajorImprovementHDFS-1055Improve thread naming for DataXceiversTodd LipconClosed
MajorSub-taskHDFS-1071savenamespace should write the fsimage to all configured fs.name.dir in parallelDmytro MolkovClosed
MajorNew FeatureHDFS-1079HDFS implementation should throw exceptions defined in AbstractFileSystemSuresh SrinivasClosed
MajorBugHDFS-1080SecondaryNameNode image transfer should use the defined http address rather than local ip addressJakob HomanClosed2 commits
MajorImprovementHDFS-1081Performance regression in DistributedFileSystem::getFileBlockLocations in secure systemsJakob HomanClosed2 commits
MajorBugHDFS-1085hftp read failing silentlyTsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-1093Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lockdhruba borthakurClosed
MajorNew FeatureHDFS-1096allow dfsadmin/mradmin refresh of superuser proxy group mappingsBoris ShkolnikClosed7 commits
MajorBugHDFS-1109HFTP and URL EncodingDmytro MolkovClosed2 commits
MajorImprovementHDFS-1110Namenode heap optimization - reuse objects for commonly used file namesSuresh SrinivasClosed2 commits
MajorNew FeatureHDFS-1111getCorruptFiles() should give some hint that the list is not completeSriram RaoClosed
MajorBugHDFS-1112Edit log buffer should not grow unboundedlyHairong KuangClosed1 commit
MajorImprovementHDFS-1114Reducing NameNode memory usage by an alternate hash tableTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-1118DFSOutputStream socket leak when cannot connect to DataNodeZheng ShaoClosed3 commits
MajorSub-taskHDFS-1119Refactor BlocksMap with GettableSetTsz Wo Nicholas SzeClosed3 commits
MajorBugHDFS-1130Pass Administrator acl to HTTPServer for common servlet access.Devaraj DasClosed2 commits
MajorBugHDFS-1138Modification times are being overwritten when FSImage loadsDmytro MolkovClosed1 commit
MajorBugHDFS-1145When NameNode is shutdown it tries to exit safemodedhruba borthakurClosed1 commit
MajorBugHDFS-1146Javadoc for getDelegationTokenSecretManager in FSNamesystemJitendra Nath PandeyClosed2 commits
MajorNew FeatureHDFS-1150Verify datanodes' identities to clients in secure clustersJakob HomanClosed12 commits
MajorBugHDFS-1157Modifications introduced by HDFS-1150 are breaking aspect's bindingsKonstantin BoudnikClosed2 commits
MajorImprovementHDFS-1160Improve some FSDataset warnings and commentsEli CollinsClosed
MajorBugHDFS-1163normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)Boris ShkolnikClosed1 commit
MajorBugHDFS-1164TestHdfsProxy is failingTodd LipconClosed1 commit
MajorTaskHDFS-1167New property for local conf directory in system-test-hdfs.xml file.Vinay Kumar ThotaClosed
MajorImprovementHDFS-1178The NameNode servlets should not use RPC to connect to the NameNodeOwen O'MalleyClosed3 commits
MajorImprovementHDFS-1187Modify fetchdt to allow renewing and canceling tokenOwen O'MalleyClosed
MajorBugHDFS-1189Quota counts missed between clear quota and set quotaJohn GeorgeClosed2 commits
MajorBugHDFS-1192refreshSuperUserGroupsConfiguration should use server side configuration for the refresh (for HADOOP-6815)Boris ShkolnikClosed1 commit
MajorBugHDFS-1198Resolving cross-realm principalsJitendra Nath PandeyClosed1 commit
MajorImprovementHDFS-1201 Support for using different Kerberos keys for Namenode and datanode.Kan ZhangClosed1 commit
MajorBugHDFS-1202DataBlockScanner throws NPE when updated before initializedTodd LipconClosed3 commits
MajorImprovementHDFS-1203DataNode should sleep before reentering service loop after an exceptionTodd LipconClosed
MajorImprovementHDFS-1205FSDatasetAsyncDiskService should name its threadsTodd LipconClosed
MajorBugHDFS-1206TestFiHFlush fails intermittentlyKonstantin BoudnikClosed
MajorBugHDFS-1250Namenode accepts block report from dead datanodesSuresh SrinivasClosed3 commits
MajorImprovementHDFS-1272HDFS changes corresponding to rename of TokenStorage to CredentialsJitendra Nath PandeyClosed1 commit
MajorBugHDFS-1283ant eclipse-files has drifted againJakob HomanClosed1 commit
MajorBugHDFS-1284TestBlockToken failsKan ZhangClosed
MajorBugHDFS-1289Datanode secure mode is brokenKan ZhangClosed2 commits
MajorBugHDFS-1296using delegation token over hftp for long running clients (spawn from hdfs-1007).Boris ShkolnikClosed3 commits
MajorImprovementHDFS-1298Add support in HDFS to update statistics that tracks number of file system operations in FileSystemSuresh SrinivasClosed2 commits
MajorBugHDFS-1301TestHDFSProxy need to use server side conf for ProxyUser stuff.Boris ShkolnikClosed2 commits
MajorImprovementHDFS-1302Use writeTokenStorageToStream method in Credentials to store credentials to a file.Jitendra Nath PandeyClosed1 commit
MajorImprovementHDFS-1304There is no unit test for HftpFileSystem.open(..)Tsz Wo Nicholas SzeClosed
MajorImprovementHDFS-1307Add start time, end time and total time taken for FSCK to FSCK reportSuresh SrinivasClosed2 commits
MajorBugHDFS-1308 job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem (part of MR-1718)Boris ShkolnikClosed1 commit
MajorTestHDFS-1310TestFileConcurrentReader failssam rashClosed
MajorImprovementHDFS-1315Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open callsSuresh SrinivasClosed2 commits
MajorBugHDFS-1317HDFSProxy needs additional changes to work after changes to streamFile servlet in HDFS-1109Rohini PalaniswamyClosed2 commits
MajorNew FeatureHDFS-1318HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scriptsTanping WangClosed3 commits
MajorSub-taskHDFS-1319Fix location of re-login for secondary namenode from HDFS-999Jakob HomanClosed1 commit
MajorImprovementHDFS-1320Add LOG.isDebugEnabled() guard for each LOG.debug("...")Erik StefflClosed
MajorNew FeatureHDFS-1330Make RPCs to DataNodes timeoutJohn GeorgeClosed3 commits
MajorBugHDFS-1334open in HftpFileSystem does not add delegation tokens to the url.Jitendra Nath PandeyClosed1 commit
MajorBugHDFS-1340A null delegation token is appended to the url if security is disabled when browsing filesystem.Jitendra Nath PandeyClosed2 commits
MajorBugHDFS-1347TestDelegationToken uses mortbay.log for loggingBoris ShkolnikClosed1 commit
MajorBugHDFS-1349Remove empty java filesEli CollinsClosed
MajorBugHDFS-1352Fix jsvc.locationEli CollinsClosed1 commit
MajorImprovementHDFS-1353Remove most of getBlockLocation optimizationJakob HomanClosed2 commits
MajorBugHDFS-1355ant veryclean (clean-cache) doesn't clean enoughLuke LuClosed
MajorImprovementHDFS-1356Provide information as to whether or not security is enabled on web interface for NameNode (part of HADOOP-6822)Boris ShkolnikClosed
MajorBugHDFS-1357HFTP traffic served by DataNode shouldn't use service port on NameNode Kan ZhangClosed
MajorBugHDFS-1361Add -fileStatus operation to NNThroughputBenchmarkKonstantin ShvachkoClosed
MajorBugHDFS-1364HFTP client should support relogin from keytabJitendra Nath PandeyClosed1 commit
MajorImprovementHDFS-1368Add a block counter to DatanodeDescriptorHairong KuangClosed
MajorBugHDFS-1372TestHDFSCLI test failuresUnassignedResolved
MajorTestHDFS-1374TestBlockRecovery#testZeroLenReplicas failsEli CollinsResolved
MajorTestHDFS-1375TestRefreshUserMappings fails w/o security enabledUnassignedResolved
MajorImprovementHDFS-1383Better error messages on hftp Tsz Wo Nicholas SzeClosed1 commit
MajorImprovementHDFS-1387Update HDFS permissions guide for securityTodd LipconClosed
MajorImprovementHDFS-1395Add @Override annotation to FSDataset methods that implement FSDatasetInterfaceSuresh SrinivasClosed
MajorBugHDFS-1399Distinct minicluster services (e.g. NN and JT) overwrite each other's service policiesAaron T. MyersClosed
MajorImprovementHDFS-1407Use Block in DataTransferProtocolSuresh SrinivasClosed
MajorImprovementHDFS-1408Herriot NN and DN clients should vend statisticsKonstantin BoudnikClosed
MajorImprovementHDFS-1417Add @Override annotation to SimulatedFSDataset methods that implement FSDatasetInterfaceSuresh SrinivasClosed
MajorBugHDFS-1421HDFS Build Crashes with Build-FI Assertion ErrorUnassignedResolved
MajorImprovementHDFS-1426Remove unused method BlockInfo#listCountHairong KuangClosed
MajorBugHDFS-1433Fix test failures - TestPread and TestFileLimitSuresh SrinivasClosed
MajorImprovementHDFS-1434Refactor Datanode#startDataNode methodSuresh SrinivasClosed
MajorImprovementHDFS-1435Provide an option to store fsimage compressedHairong KuangClosed
MajorBugHDFS-1440TestComputeInvalidateWork fails intermittentlySuresh SrinivasClosed
MajorImprovementHDFS-1454Update the documentation to reflect true client caching strategyHarsh JClosed
MajorImprovementHDFS-1456Provide builder for constructing instances of MiniDFSClusterJakob HomanClosed1 commit
MajorImprovementHDFS-1457Limit transmission rate when transfering image between primary and secondary NNsHairong KuangClosed1 commit
MajorSub-taskHDFS-1462Refactor edit log loading to a separate class from edit log writingTodd LipconClosed
MajorImprovementHDFS-1472Refactor DFSck to allow programmatic access to outputRamkumar VadaliClosed
MajorSub-taskHDFS-1473Refactor storage management into separate classes than fsimage file reading/writingTodd LipconClosed
MajorBugHDFS-1483DFSClient.getBlockLocations returns BlockLocations with no indication that the corresponding blocks are corruptPatrick KlingClosed
MajorBugHDFS-1487FSDirectory.removeBlock() should update diskspace count of the block owner nodeZhong WangClosed2 commits
MajorImprovementHDFS-1491Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)Sanjay RadiaClosed
MajorBugHDFS-1500TestOfflineImageViewer failing on trunkTodd LipconClosed
MajorBugHDFS-1523TestLargeBlock is failing on trunkKonstantin BoudnikClosed
MajorBugHDFS-1527SocketOutputStream.transferToFully fails for blocks >= 2GB on 32 bit JVMPatrick KlingClosed
MajorBugHDFS-1532Exclude Findbugs warning in FSImageFormat$SaverTodd LipconClosed
MajorBugHDFS-1544Ivy resolve force mode should be turned off by defaultLuke LuClosed
MajorBugHDFS-1549ArrayIndexOutOfBoundsException throwed from BlockLocation UnassignedResolved
MajorTestHDFS-1562Add rack policy testsEli CollinsClosed
MajorImprovementHDFS-1582Remove auto-generated native build filesRoman ShaposhnikClosed
MajorBugHDFS-1591Fix javac, javadoc, findbugs warningsPo CheungClosed
MajorImprovementHDFS-1596Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xmlHarsh JClosed
MajorBugHDFS-1598ListPathsServlet excludes .*.crc filesTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-1602NameNode storage failed replica restoration is brokenBoris ShkolnikClosed
MajorBugHDFS-1615seek() on closed DFS input stream throws NPEScott CareyClosed
MajorSub-taskHDFS-1617CLONE to COMMON - Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per fileMatt FoleyResolved
1200 of 294