Version 0.21.0

RELEASED

Start date not set

Released: 23/Aug/10

Release Notes

PTKeySummaryAssigneeStatusDevelopment
BlockerBugHDFS-101DFS write pipeline : DFSClient sometimes does not detect second datanode failure Hairong KuangClosed6 commits
BlockerBugHDFS-439HADOOP-5961 is incorrectly committed.Raghu AngadiClosed
BlockerBugHDFS-456Problems with dfs.name.edits.dirs as URIKonstantin ShvachkoClosed1 commit
BlockerBugHDFS-464Memory leaks in libhdfsChristian KunzClosed2 commits
BlockerSub-taskHDFS-564Adding pipeline test 17-35Hairong KuangClosed1 commit
BlockerTaskHDFS-574Hadoop Doc Split: HDFS DocsCorinne ChandelClosed2 commits
BlockerBugHDFS-596Memory leak in libhdfs: hdfsFreeFileInfo() in libhdfs does not free memory for mOwner and mGroupZhang BingjunClosed4 commits
BlockerBugHDFS-609Create a file with the append flag does not work in HDFSTom WhiteClosed1 commit
BlockerBugHDFS-615TestLargeDirectoryDelete fails with NullPointerExceptionUnassignedClosed
BlockerBugHDFS-637DataNode sends a Success ack when block write failsHairong KuangClosed2 commits
BlockerBugHDFS-641Move all of the benchmarks and tests that depend on mapreduce to mapreduceOwen O'MalleyClosed2 commits
BlockerBugHDFS-646missing test-contrib ant target would break hudson patch test processGiridharan KesavanClosed1 commit
BlockerTaskHDFS-651HDFS Docs - fix listing of docs in the doc menuCorinne ChandelClosed1 commit
BlockerBugHDFS-653Multiple unit tests fail in branch-0.21UnassignedClosed
BlockerBugHDFS-673BlockReceiver#PacketResponder should not remove a packet from the ack queue before its ack is sentHairong KuangClosed1 commit
BlockerBugHDFS-677Rename failure due to quota results in deletion of src directorySuresh SrinivasClosed5 commits
BlockerBugHDFS-690TestAppend2#testComplexAppend failed on "Too many open files"Hairong KuangClosed1 commit
BlockerTaskHDFS-715Hadoop HDFS - Site LogoCorinne ChandelClosed
BlockerBugHDFS-724Pipeline close hangs if one of the datanode is not responsive.Hairong KuangClosed4 commits
BlockerBugHDFS-750TestRename build failureSuresh SrinivasClosed1 commit
BlockerBugHDFS-781Metrics PendingDeletionBlocks is not decrementedSuresh SrinivasClosed3 commits
BlockerBugHDFS-787Make the versions of libraries consistentOwen O'MalleyClosed2 commits
BlockerBugHDFS-791Build is broken after HDFS-787 patch has been appliedKonstantin BoudnikClosed1 commit
BlockerBugHDFS-792TestHDFSCLI is failing Todd LipconClosed2 commits
BlockerBugHDFS-793DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packetHairong KuangClosed5 commits
BlockerBugHDFS-797TestHDFSCLI much slower after HDFS-265 mergeTodd LipconClosed1 commit
BlockerBugHDFS-812FSNamesystem#internalReleaseLease throws NullPointerException on a single-block file's lease recoveryKonstantin BoudnikClosed1 commit
BlockerImprovementHDFS-822Appends to already-finalized blocks can rename across volumesHairong KuangClosed1 commit
BlockerBugHDFS-894DatanodeID.ipcPort is not updated when existing node re-registersTodd LipconClosed1 commit
BlockerBugHDFS-909Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits logTodd LipconClosed4 commits
BlockerBugHDFS-939libhdfs test is brokenEli CollinsClosed1 commit
BlockerBugHDFS-940libhdfs uses UnixUserGroupInformationUnassignedClosed
BlockerBugHDFS-995Replace usage of FileStatus#isDir()Eli CollinsClosed1 commit
BlockerBugHDFS-1000libhdfs needs to be updated to use the new UGIDevaraj DasClosed3 commits
BlockerBugHDFS-1002Secondary Name Node crash, NPE in edit log replayUnassignedClosed
BlockerBugHDFS-1024SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyExceptionDmytro MolkovClosed2 commits
BlockerBugHDFS-1046Build fails trying to download an old version of tomcatSrikanth SundarrajanClosed1 commit
BlockerSub-taskHDFS-1057Concurrent readers hit ChecksumExceptions if following a writer to very end of filesam rashClosed2 commits
BlockerImprovementHDFS-1107Turn on append by default.Konstantin ShvachkoClosed1 commit
BlockerImprovementHDFS-1126Change HDFS to depend on Hadoop 'common' artifacts instead of 'core'Tom WhiteClosed1 commit
BlockerImprovementHDFS-1161Make DN minimum valid volumes configurableEli CollinsClosed2 commits
BlockerBugHDFS-1165createSymlink should not hold the fsnamesytem lock when sync its edit log to diskEli CollinsClosed
BlockerBugHDFS-1181Move configuration and script files post project splitTom WhiteClosed3 commits
BlockerBugHDFS-1212Harmonize HDFS JAR library versions with CommonTom WhiteClosed1 commit
BlockerBugHDFS-1255test-libhdfs.sh failsTom WhiteClosed2 commits
BlockerBugHDFS-1256libhdfs is missing from the tarballTom WhiteClosed1 commit
BlockerBugHDFS-1258Clearing namespace quota on "/" corrupts FS imageAaron T. MyersClosed4 commits
BlockerBugHDFS-1288start-all.sh / stop-all.sh does not seem to work with HDFSUnassignedClosed
BlockerBugHDFS-1292Allow artifacts to be published to the staging Apache Nexus Maven RepositoryGiridharan KesavanResolved
CriticalBugHDFS-15Rack replication policy can be violated for over replicated blocks Jitendra Nath PandeyClosed1 commit
CriticalNew FeatureHDFS-447proxy to call LDAP for IP lookup and get user ID and directories, validate requested URLzhiyong zhangClosed1 commit
CriticalBugHDFS-756libhdfs unit tests do not run Eli CollinsClosed1 commit
CriticalBugHDFS-825Build fails to pull latest hadoop-core-* artifactsKonstantin BoudnikClosed1 commit
CriticalTaskHDFS-8690.21.0 - snapshot incorrect dependency published in .pom filesGiridharan KesavanClosed
CriticalBugHDFS-927DFSInputStream retries too many times for new block locationsTodd LipconClosed4 commits
CriticalBugHDFS-1267fuse-dfs does not compileDevaraj DasClosed1 commit
CriticalImprovementHDFS-2600regarding HDFS-RAIDUnassignedResolved
MajorBugHDFS-29In Datanode, update block may fail due to length inconsistencyTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-76Namespace quota exceeded message unclearBoris ShkolnikClosed1 commit
MajorBugHDFS-94The "Heap Size" in HDFS web ui may not be accurateDmytro MolkovClosed1 commit
MajorBugHDFS-95UnknownHostException if the system can't determine its own name and you go DNS.getIPs("name-of-an-unknown-interface");Steve LoughranResolved
MajorBugHDFS-119logSync() may block NameNode forever.Suresh SrinivasClosed4 commits
MajorBugHDFS-127DFSClient block read failures cause open DFSInputStream to become unusableIgor BolotinClosed6 commits
MajorBugHDFS-145FSNameSystem#addStoredBlock does not handle inconsistent block length correctlyHairong KuangClosed1 commit
MajorImprovementHDFS-173Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completesSuresh SrinivasClosed2 commits
MajorBugHDFS-187TestStartup fails if hdfs is running in the same machineTodd LipconClosed4 commits
MajorBugHDFS-192TestBackupNode sometimes failsKonstantin ShvachkoClosed1 commit
MajorBugHDFS-195Need to handle access token expiration when re-establishing the pipeline for dfs writeKan ZhangClosed2 commits
MajorNew FeatureHDFS-204Revive number of files listed metricsJitendra Nath PandeyClosed2 commits
MajorNew FeatureHDFS-222Support for concatenating of files into a single fileBoris ShkolnikClosed1 commit
MajorNew FeatureHDFS-235Add support for byte-ranges to hftpBill ZellerClosed1 commit
MajorNew FeatureHDFS-245Create symbolic links in HDFSEli CollinsClosed1 commit
MajorSub-taskHDFS-254Add more unit test for HDFS symlinksEli CollinsResolved
MajorTaskHDFS-256Split HDFS into sub projectOwen O'MalleyClosed
MajorImprovementHDFS-265Revisit appendHairong KuangClosed67 commits
MajorImprovementHDFS-278Should DFS outputstream's close wait forever?dhruba borthakurClosed4 commits
MajorImprovementHDFS-288Redundant computation in hashCode() implemenationTsz Wo Nicholas SzeClosed1 commit
MajorImprovementHDFS-352saveNamespace command should be documented.Ravi PhulariClosed1 commit
MajorSub-taskHDFS-377Code Refactoring: separate codes which implement DataTransferProtocolTsz Wo Nicholas SzeClosed1 commit
MajorImprovementHDFS-381Datanode should report deletion of blocks to Namenode explicitlySuresh SrinivasClosed1 commit
MajorImprovementHDFS-385Design a pluggable interface to place replicas of blocks in HDFSdhruba borthakurClosed3 commits
MajorSub-taskHDFS-396Process dfs.name.edits.dirs as URI Luca TelloliClosed2 commits
MajorTestHDFS-409Add more access token testsKan ZhangClosed2 commits
MajorImprovementHDFS-412Hadoop JMX usage makes Nagios monitoring impossibleBrian BockelmanClosed3 commits
MajorBugHDFS-415Unchecked exception thrown inside of BlockReceiver cause some threads hangKonstantin BoudnikClosed1 commit
MajorBugHDFS-423Unbreak FUSE build and fuse_dfs_wrapper.shEli CollinsClosed2 commits
MajorSub-taskHDFS-436AspectJ framework for HDFS code and testsKonstantin BoudnikClosed1 commit
MajorBugHDFS-440javadoc warnings: broken linksTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-441TestFTPFileSystem failsTsz Wo Nicholas SzeClosed1 commit
MajorImprovementHDFS-443New metrics in namenode to capture lost heartbeats.Jitendra Nath PandeyClosed1 commit
MajorBugHDFS-445pread() fails when cached block locations are no longer validKan ZhangClosed3 commits
MajorBugHDFS-454HDFS workflow in JIRA does not match MAPREDUCE, HADOOPOwen O'MalleyClosed
MajorImprovementHDFS-457better handling of volume failure in Data Node storageBoris ShkolnikClosed4 commits
MajorNew FeatureHDFS-458Create target for 10 minute patch test build for hdfsJakob HomanClosed2 commits
MajorNew FeatureHDFS-459Job History Log AnalyzerKonstantin ShvachkoClosed1 commit
MajorNew FeatureHDFS-461Analyzing file size distribution.Konstantin ShvachkoClosed1 commit
MajorBugHDFS-462Unit tests not working under WindowsJakob HomanClosed1 commit
MajorBugHDFS-463CreateEditsLog utility broken due to FSImage URL scheme checkSuresh SrinivasClosed1 commit
MajorBugHDFS-466hdfs_write infinite loop when dfs fails and cannot write files > 2 GBPete WyckoffClosed1 commit
MajorBugHDFS-472Document hdfsproxy design and set-up guidezhiyong zhangClosed1 commit
MajorSub-taskHDFS-475Create a separate targets for fault injection related test and jar files creation filesKonstantin BoudnikClosed1 commit
MajorBugHDFS-480Typo in jar name in build.xmlKonstantin ShvachkoClosed1 commit
MajorBugHDFS-481Bug Fixes + HdfsProxy to use proxy user to impresonate the real userSrikanth SundarrajanClosed3 commits
MajorBugHDFS-482change HsftpFileSystem's ssl.client.do.not.authenticate.server configuration setting to ssl-client.xml Srikanth SundarrajanClosed1 commit
MajorBugHDFS-483Data transfer (aka pipeline) implementation cannot tolerate exceptionsUnassignedClosed
MajorBugHDFS-484bin-package and package doesnt seem to package any jar fileGiridharan KesavanClosed1 commit
MajorBugHDFS-489Updated TestHDFSCLI for changes from HADOOP-6139Jakob HomanClosed1 commit
MajorNew FeatureHDFS-492Expose corrupt replica/block informationBill ZellerClosed1 commit
MajorImprovementHDFS-493Only fault-injected tests have to be executed by run-test-*-faul-inject targets; none of fault-injected tests need to be ran normal testing processKonstantin BoudnikClosed1 commit
MajorSub-taskHDFS-498Add development guide and framework documentationKonstantin BoudnikClosed1 commit
MajorBugHDFS-499Fix deprecation warnings introduced by HADOOP-5438Jakob HomanClosed
MajorSub-taskHDFS-501Use enum to define the constants in DataTransferProtocolTsz Wo Nicholas SzeClosed1 commit
MajorNew FeatureHDFS-503Implement erasure coding as a layer on HDFSdhruba borthakurClosed1 commit
MajorSub-taskHDFS-508Factor out BlockInfo from BlocksMapKonstantin ShvachkoClosed1 commit
MajorImprovementHDFS-510Rename DatanodeBlockInfo to be ReplicaInfoJakob HomanClosed4 commits
MajorImprovementHDFS-511Redundant block searches in BlockManager.Konstantin ShvachkoClosed1 commit
MajorImprovementHDFS-512Set block id as the key to BlockKonstantin ShvachkoClosed1 commit
MajorBugHDFS-514DFSClient.namenode is a public field. Should be private.Bill ZellerClosed1 commit
MajorSub-taskHDFS-519Create new tests for lease recoveryKonstantin BoudnikClosed1 commit
MajorSub-taskHDFS-520Create new tests for block recoveryHairong KuangClosed1 commit
MajorSub-taskHDFS-521Create new tests for pipelineKonstantin BoudnikClosed1 commit
MajorSub-taskHDFS-524Further DataTransferProtocol code refactoring.Tsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-525ListPathsServlet.java uses static SimpleDateFormat that has threading issuesSuresh SrinivasClosed9 commits
MajorImprovementHDFS-527Refactor DFSClient constructorsTsz Wo Nicholas SzeClosed3 commits
MajorImprovementHDFS-529More redundant block searches in BlockManager.Konstantin ShvachkoClosed1 commit
MajorImprovementHDFS-530Refactor TestFileAppend* to remove code duplicationsKonstantin BoudnikClosed1 commit
MajorImprovementHDFS-531Renaming of configuration keysJitendra Nath PandeyClosed
MajorImprovementHDFS-532Allow applications to know that a read request failed because block is missingdhruba borthakurClosed1 commit
MajorBugHDFS-534Required avro classes are missingTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-538DistributedFileSystem::listStatus incorrectly returns null for empty result setsJakob HomanClosed1 commit
MajorBugHDFS-540TestNameNodeMetrics fails intermittentlySuresh SrinivasClosed
MajorImprovementHDFS-546DatanodeDescriptor block iterator should be BlockInfo based rather than Block.Konstantin ShvachkoClosed2 commits
MajorImprovementHDFS-548TestFsck takes nearly 10 minutes to run - a quarter of the entire hdfs-test timeHairong KuangClosed1 commit
MajorImprovementHDFS-549Allow non fault-inject specific tests execution with an explicit -Dtestcase=... settingKonstantin BoudnikClosed3 commits
MajorSub-taskHDFS-551Create new functional test for a block report.Konstantin BoudnikClosed1 commit
MajorBugHDFS-553BlockSender reports wrong failed position in ChecksumExceptionHairong KuangClosed3 commits
MajorSub-taskHDFS-561Fix write pipeline READ_TIMEOUTKan ZhangClosed3 commits
MajorNew FeatureHDFS-567Two contrib tools to facilitate searching for block history information Jitendra Nath PandeyClosed1 commit
MajorImprovementHDFS-578Support for using server default values for blockSize and replication when creating a fileKan ZhangClosed1 commit
MajorImprovementHDFS-581Introduce an iterator over blocks in the block report array.Konstantin ShvachkoClosed2 commits
MajorImprovementHDFS-584Fail the fault-inject build if any advices are mis-boundKonstantin BoudnikClosed1 commit
MajorBugHDFS-586TestBlocksWithNotEnoughRacks failsJitendra Nath PandeyClosed1 commit
MajorBugHDFS-587Test programs support only default queue.Erik StefflClosed4 commits
MajorBugHDFS-590When trying to rename a non-existent path, LocalFileSystem throws an FileNotFoundException, while HDFS returns falseJitendra Nath PandeyClosed
MajorNew FeatureHDFS-595FsPermission tests need to be updated for new octal configuration parameter from HADOOP-6234Jakob HomanClosed2 commits
MajorBugHDFS-601TestBlockReport should obtain data directories from MiniHDFSClusterKonstantin BoudnikClosed1 commit
MajorBugHDFS-602Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundExceptionBoris ShkolnikClosed1 commit
MajorImprovementHDFS-605There's not need to run fault-inject tests by 'run-test-hdfs-with-mr' targetKonstantin BoudnikClosed1 commit
MajorBugHDFS-606ConcurrentModificationException in invalidateCorruptReplicas()Konstantin ShvachkoClosed3 commits
MajorNew FeatureHDFS-610Add support for FileContextSanjay RadiaClosed1 commit
MajorBugHDFS-611Heartbeats times from Datanodes increase when there are plenty of blocks to deleteZheng ShaoClosed3 commits
MajorBugHDFS-612FSDataset should not use org.mortbay.log.LogTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-614TestDatanodeBlockScanner obtain should data-node directories directly from MiniDFSClusterKonstantin ShvachkoClosed1 commit
MajorSub-taskHDFS-616Create functional tests for new design of the block reportKonstantin BoudnikClosed1 commit
MajorImprovementHDFS-617Support for non-recursive create() in HDFSKan ZhangClosed3 commits
MajorImprovementHDFS-618Support for non-recursive mkdir in HDFSKan ZhangClosed1 commit
MajorBugHDFS-622checkMinReplication should count only live node.Konstantin ShvachkoClosed1 commit
MajorBugHDFS-625ListPathsServlet throws NullPointerExceptionSuresh SrinivasClosed4 commits
MajorBugHDFS-629Remove ReplicationTargetChooser.java along with fixing import warnings.dhruba borthakurClosed2 commits
MajorImprovementHDFS-630In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block.Cosmin LeheneClosed9 commits
MajorImprovementHDFS-631Changes in HDFS to rename the config keys as detailed in HDFS-531.Jitendra Nath PandeyClosed1 commit
MajorBugHDFS-638The build.xml refences jars that don't existOwen O'MalleyClosed
MajorBugHDFS-640TestHDFSFileContextMainOperations uses old FileContext.mkdirs(..)Suresh SrinivasClosed1 commit
MajorBugHDFS-647Internal server errorsOwen O'MalleyClosed
MajorNew FeatureHDFS-654HDFS needs to support new rename introduced for FileContextSuresh SrinivasClosed1 commit
MajorSub-taskHDFS-660Remove deprecated methods from InterDatanodeProtocol.Konstantin ShvachkoClosed1 commit
MajorSub-taskHDFS-663DFSIO for appendKonstantin ShvachkoClosed
MajorSub-taskHDFS-668TestFileAppend3#TC7 sometimes hangsHairong KuangClosed1 commit
MajorTestHDFS-669Add unit tests framework (Mockito)Konstantin BoudnikClosed2 commits
MajorSub-taskHDFS-676NPE in FSDataset.updateReplicaUnderRecovery(..)Konstantin ShvachkoClosed1 commit
MajorBugHDFS-679Appending to a partial chunk incorrectly assumes the first packet fills up the partial chunkHairong KuangClosed1 commit
MajorImprovementHDFS-680Add new access method to a copy of a block's replicaKonstantin ShvachkoClosed1 commit
MajorBugHDFS-682TestBlockUnderConstruction failsTsz Wo Nicholas SzeClosed1 commit
MajorImprovementHDFS-685Use the user-to-groups mapping service in the NameNodeBoris ShkolnikClosed3 commits
MajorBugHDFS-688Add configuration resources to DFSAdminKonstantin ShvachkoClosed1 commit
MajorBugHDFS-691Limitation on java.io.InputStream.available()Tsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-695RaidNode should read in configuration from hdfs-site.xmldhruba borthakurClosed1 commit
MajorBugHDFS-699Primary datanode should compare replicas' on disk lengthsHairong KuangClosed1 commit
MajorNew FeatureHDFS-702Add Hdfs Impl for the new file system interfaceSanjay RadiaClosed1 commit
MajorImprovementHDFS-703Replace current fault injection implementation with one from CommonKonstantin BoudnikClosed2 commits
MajorImprovementHDFS-704Unify build property names to facilitate cross-projects modificationsKonstantin BoudnikClosed1 commit
MajorTestHDFS-705Create an adapter to access some of package-private methods of DataNode from testsKonstantin BoudnikClosed1 commit
MajorBugHDFS-706Intermittent failures in TestFiHFlushKonstantin BoudnikClosed1 commit
MajorImprovementHDFS-707Remove unused method INodeFile.toINodeFileUnderConstruction()Konstantin ShvachkoClosed
MajorBugHDFS-709TestDFSShell failureSuresh SrinivasClosed4 commits
MajorTestHDFS-710Add actions with constraints to the pipeline fault injection testsTsz Wo Nicholas SzeClosed1 commit
MajorTestHDFS-713Need to properly check the type of the test class from an aspectKonstantin BoudnikClosed1 commit
MajorTestHDFS-714Create fault injection test for the new pipeline closeTsz Wo Nicholas SzeClosed
MajorSub-taskHDFS-716Define a pointcut for pipeline closeTsz Wo Nicholas SzeClosed1 commit
MajorSub-taskHDFS-719Add more fault injection tests for pipeline closeTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-720NPE in BlockReceiver$PacketResponder.run(BlockReceiver.java:923)UnassignedClosed
MajorBugHDFS-722The pointcut callCreateBlockWriteStream in FSDatasetAspects is brokenTsz Wo Nicholas SzeClosed1 commit
MajorBugHDFS-725Support the build error fix for HADOOP-6327Sanjay RadiaClosed1 commit
MajorBugHDFS-726Eclipse .classpath template has outdated jar files and is missing some new ones.Konstantin BoudnikClosed1 commit
MajorImprovementHDFS-728Create a comprehensive functional test for appendHairong KuangClosed1 commit
MajorImprovementHDFS-729fsck option to list only corrupted filesRodrigo SchmidtClosed1 commit
MajorSub-taskHDFS-730Add fault injection tests for pipleline close ackTsz Wo Nicholas SzeClosed1 commit
MajorNew FeatureHDFS-731Support new Syncable interface in HDFSHairong KuangClosed1 commit
MajorBugHDFS-735TestReadWhileWriting has wrong line termination symbolsKonstantin BoudnikClosed1 commit
MajorImprovementHDFS-736commitBlockSynchronization() should directly update block GS and length.Konstantin ShvachkoClosed1 commit
1200 of 327