Version 2.0.0-alpha

RELEASED

Start date not set

Released: 23/May/12

Release Notes

hadoop-2.0.0-alpha releaseShow more
PTKeySummaryAssigneeStatusDevelopment
BlockerBugHDFS-2878TestBlockRecovery does not compileTodd LipconClosed3 commits
BlockerBugHDFS-2968Protocol translator for BlockRecoveryCommand broken when multiple blocks need recoveryTodd LipconClosed2 commits
BlockerBugHDFS-3142TestHDFSCLI.testAll is failingBrandon LiClosed2 commits
BlockerBugHDFS-3214InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecoveryTodd LipconClosed2 commits
CriticalBugHDFS-2405hadoop dfs command with webhdfs fails on secure hadoopJitendra Nath PandeyClosed3 commits
CriticalBugHDFS-2532TestDfsOverAvroRpc timing out in trunkUma Maheswara Rao GClosed3 commits
CriticalBugHDFS-2739SecondaryNameNode doesn't start upJitendra Nath PandeyClosed2 commits
CriticalBugHDFS-3020Auto-logSync based on edit log buffer size brokenTodd LipconClosed3 commits
CriticalBugHDFS-3062Fail to submit mapred job on a secured-HA-HDFS: logic URI cannot be picked up by job submission.Mingjie LaiClosed4 commits
CriticalBugHDFS-3083Cannot run an MR job with HA and security enabled when second-listed NN activeAaron T. MyersClosed2 commits
CriticalBugHDFS-3093TestAllowFormat is trying to be interactiveTodd LipconClosed2 commits
CriticalBugHDFS-3255HA DFS returns wrong token serviceDaryn SharpClosed2 commits
CriticalBugHDFS-3268Hdfs mishandles token service & incompatible with HADaryn SharpClosed2 commits
CriticalBugHDFS-3280DFSOutputStream.sync should not be synchronizedTodd LipconClosed1 commit
CriticalBugHDFS-3330If GetImageServlet throws an Error or RTE, response has HTTP "OK" statusTodd LipconClosed3 commits
CriticalBugHDFS-3357DataXceiver reads from client socket with incorrect/no timeoutTodd LipconClosed3 commits
CriticalBugHDFS-3376DFSClient fails to make connection to DN if there are many unusable cached socketsTodd LipconClosed3 commits
MajorNew FeatureHDFS-234Integration with BookKeeper logging systemIvan KellyClosed5 commits
MajorImprovementHDFS-309FSEditLog should log progress during replaySho ShimauchiClosed2 commits
MajorSub-taskHDFS-395DFS Scalability: Incremental block reportsTomasz NykielClosed4 commits
MajorImprovementHDFS-1580Add interface for generic Write Ahead Logging mechanismsJitendra Nath PandeyClosed5 commits
MajorNew FeatureHDFS-1623High Availability Framework for HDFS NNUnassignedClosed255 commits
MajorBugHDFS-1765Block Replication should respect under-replication block priorityUma Maheswara Rao GClosed5 commits
MajorSub-taskHDFS-20181073: Move all journal stream management code into one placeIvan KellyClosed2 commits
MajorSub-taskHDFS-2158Add JournalSet to manage the set of journals.Jitendra Nath PandeyClosed3 commits
MajorSub-taskHDFS-2181Separate HDFS Client wire protocol data typesSanjay RadiaClosed2 commits
MajorImprovementHDFS-2188HDFS-1580: Make FSEditLog create its journals from a list of URIs rather than NNStorageIvan KellyClosed4 commits
MajorImprovementHDFS-2223Untangle depencencies between NN componentsTodd LipconClosed2 commits
MajorImprovementHDFS-2303Unbundle jsvcMingjie LaiClosed2 commits
MajorSub-taskHDFS-2334Add Closeable to JournalManagerIvan KellyClosed3 commits
MajorImprovementHDFS-2337DFSClient shouldn't keep multiple RPC proxy referencesAaron T. MyersClosed2 commits
MajorImprovementHDFS-2351Change Namenode and Datanode to register each of their protocols seperately Sanjay RadiaClosed1 commit
MajorImprovementHDFS-2413Add public APIs for safemodeHarsh JClosed2 commits
MajorNew FeatureHDFS-2430The number of failed or low-resource volumes the NN can tolerate should be configurableAaron T. MyersClosed1 commit
MajorSub-taskHDFS-2459Separate datatypes for Journal protocolSuresh SrinivasClosed3 commits
MajorSub-taskHDFS-2476More CPU efficient data structure for under-replicated/over-replicated/invalidate blocksTomasz NykielClosed4 commits
MajorSub-taskHDFS-2477Optimize computing the diff between a block report and the namenode state.Tomasz NykielClosed6 commits
MajorSub-taskHDFS-2479HDFS Client Data Types in Protocol BuffersSanjay RadiaClosed2 commits
MajorSub-taskHDFS-2480Separate datatypes for NamenodeProtocolSuresh SrinivasClosed2 commits
MajorBugHDFS-2481Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocolSanjay RadiaClosed2 commits
MajorSub-taskHDFS-2488Separate datatypes for InterDatanodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2489Move commands Finalize and Register out of DatanodeCommand class.Suresh SrinivasClosed3 commits
MajorSub-taskHDFS-2495Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lockTomasz NykielClosed4 commits
MajorImprovementHDFS-2496Separate datatypes for DatanodeProtocolSuresh SrinivasClosed3 commits
MajorBugHDFS-2497Fix TestBackupNode failureSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2499Fix RPC client creation bug from HDFS-2459Suresh SrinivasClosed3 commits
MajorSub-taskHDFS-2517Protobuf - Add protocol service for JournalProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2518Protobuf - Add protobuf service for NamenodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2519Protobuf - Add protobuf service for DatanodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2520Protobuf - Add protobuf service for InterDatanodeProtocolSuresh SrinivasClosed2 commits
MajorBugHDFS-2526(Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetryAaron T. MyersClosed2 commits
MajorSub-taskHDFS-2581Implement protobuf service for JournalProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2597 ClientNameNodeProtocol in Protocol BuffersSanjay RadiaClosed2 commits
MajorSub-taskHDFS-2618Implement protobuf service for NamenodeProtocolSuresh SrinivasClosed3 commits
MajorSub-taskHDFS-2629Implement protobuf service for InterDatanodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2636Implement protobuf service for ClientDatanodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2642Protobuf translators for DatanodeProtocolJitendra Nath PandeyClosed2 commits
MajorSub-taskHDFS-2647Enable protobuf RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol and NamenodeProtocolSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2651ClientNameNodeProtocol Translators for Protocol BuffersSanjay RadiaClosed2 commits
MajorSub-taskHDFS-2661Enable protobuf RPC for DatanodeProtocolJitendra Nath PandeyClosed2 commits
MajorSub-taskHDFS-2663Optional parameters are not handled correctlySuresh SrinivasClosed4 commits
MajorSub-taskHDFS-2666TestBackupNode failsSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2669Enable protobuf rpc for ClientNamenodeProtocolSanjay RadiaClosed2 commits
MajorBugHDFS-2676Remove Avro RPCSuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2687Tests are failing with ClassCastException, due to new protocol changes Suresh SrinivasClosed2 commits
MajorBugHDFS-2694Removal of Avro broke non-PB NN servicesAaron T. MyersClosed2 commits
MajorBugHDFS-2696Fix the fuse-fds buildBruno MahéClosed2 commits
MajorSub-taskHDFS-2697Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffersJitendra Nath PandeyClosed2 commits
MajorBugHDFS-2700TestDataNodeMultipleRegistrations is failing in trunkUma Maheswara Rao GClosed2 commits
MajorNew FeatureHDFS-2731HA: Autopopulate standby name dirs if they're emptyTodd LipconClosed2 commits
MajorBugHDFS-2765TestNameEditsConfigs is incorrectly swallowing IOEAaron T. MyersClosed3 commits
MajorBugHDFS-2768BackupNode stop can not close proxy connections because it is not a proxy instance.Uma Maheswara Rao GClosed2 commits
MajorBugHDFS-2799Trim fs.checkpoint.dir valuesamithClosed2 commits
MajorSub-taskHDFS-2801Provide a method in client side translators to check for a methods supported in underlying protocol.Jitendra Nath PandeyClosed2 commits
MajorSub-taskHDFS-2880Protocol buffer changes to add support multiple storagesSuresh SrinivasClosed2 commits
MajorImprovementHDFS-2895Remove Writable wire protocol related code that is no longer necessarySuresh SrinivasClosed2 commits
MajorSub-taskHDFS-2899Service protocol change to support multiple storages added in HDFS-2880Suresh SrinivasClosed2 commits
MajorNew FeatureHDFS-2941Add an administrative command to download a copy of the fsimage from the NNAaron T. MyersClosed3 commits
MajorImprovementHDFS-2983Relax the build version check to permit rolling upgrades within a releaseAaron T. MyersClosed2 commits
MajorBugHDFS-2995start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configuredEli CollinsClosed2 commits
MajorNew FeatureHDFS-3000Add a public API for setting quotasAaron T. MyersClosed2 commits
MajorNew FeatureHDFS-3004Implement Recovery ModeColin P. McCabeClosed2 commits
MajorBugHDFS-3005ConcurrentModificationException in FSDataset$FSVolume.getDfsUsed(..)Tsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-3014FSEditLogOp and its subclasses should have toString() methodSho ShimauchiClosed3 commits
MajorImprovementHDFS-3021Use generic type to declare FSDatasetInterfaceTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3026HA: Handle failure during HA state transitionAaron T. MyersClosed3 commits
MajorImprovementHDFS-3030Remove getProtocolVersion and getProtocolSignature from translatorsJitendra Nath PandeyClosed2 commits
MajorImprovementHDFS-3044fsck move should be non-destructive by defaultColin P. McCabeClosed4 commits
MajorImprovementHDFS-3056Add an interface for DataBlockScanner loggingTsz Wo Nicholas SzeClosed3 commits
MajorBugHDFS-3057httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIRRoman ShaposhnikClosed2 commits
MajorBugHDFS-3070HDFS balancer doesn't ensure that hdfs-site.xml is loadedAaron T. MyersClosed2 commits
MajorImprovementHDFS-3071haadmin failover command does not provide enough detail for when target NN is not ready to be activeTodd LipconClosed2 commits
MajorSub-taskHDFS-3082Clean up FSDatasetInterfaceTsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-3084FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:portTodd LipconClosed2 commits
MajorSub-taskHDFS-3086Change Datanode not to send storage list in registration - it will be sent in block reportTsz Wo Nicholas SzeClosed2 commits
MajorSub-taskHDFS-3088Move FSDatasetInterface inner classes to a packageTsz Wo Nicholas SzeClosed2 commits
MajorSub-taskHDFS-3089Move FSDatasetInterface and other related classes/interfaces to a packageTsz Wo Nicholas SzeClosed6 commits
MajorImprovementHDFS-3091Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters.Tsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-3094add -nonInteractive and -force option to namenode -format commandArpit GuptaClosed3 commits
MajorBugHDFS-3099SecondaryNameNode does not properly initialize metrics systemAaron T. MyersClosed2 commits
MajorBugHDFS-3100failed to append dataBrandon LiClosed2 commits
MajorNew FeatureHDFS-3102Add CLI tool to initialize the shared-edits dirAaron T. MyersClosed2 commits
MajorSub-taskHDFS-3105Add DatanodeStorage information to block recoveryTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3109Remove hsqldb exclusions from pom.xmlRavi PrakashClosed2 commits
MajorImprovementHDFS-3120Enable hsync and hflush by defaultEli CollinsClosed2 commits
MajorSub-taskHDFS-3126Journal stream from the namenode to backup needs to have a timeoutHari MankudeClosed1 commit
MajorSub-taskHDFS-3130Move FSDataset implemenation to a packageTsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-3137Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16Eli CollinsClosed3 commits
MajorImprovementHDFS-3138Move DatanodeInfo#ipcPort to DatanodeIDEli CollinsClosed2 commits
MajorBugHDFS-3143TestGetBlocks.testGetBlocks is failingArpit GuptaClosed2 commits
MajorImprovementHDFS-3144Refactor DatanodeID#getName by useEli CollinsClosed3 commits
MajorNew FeatureHDFS-3148The client should be able to use multiple local interfaces for data transferEli CollinsClosed5 commits
MajorSub-taskHDFS-3155Clean up FSDataset implemenation related code.Tsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3156TestDFSHAAdmin is failing post HADOOP-8202Aaron T. MyersClosed2 commits
MajorImprovementHDFS-3158LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DNAaron T. MyersClosed2 commits
MajorImprovementHDFS-3164Move DatanodeInfo#hostName to DatanodeIDEli CollinsClosed2 commits
MajorImprovementHDFS-3171The DatanodeID "name" field is overloaded Eli CollinsClosed2 commits
MajorImprovementHDFS-3179Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode clusterTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3199TestValidateConfigurationSettings is failingTodd LipconClosed2 commits
MajorBugHDFS-3202NamespaceInfo PB translation drops build versionAaron T. MyersClosed2 commits
MajorImprovementHDFS-3204Minor modification to JournalProtocol.proto to make it genericSuresh SrinivasClosed1 commit
MajorBugHDFS-3208Bogus entries in hosts files are incorrectly displayed in the report Eli CollinsClosed2 commits
MajorBugHDFS-3210JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name"Eli CollinsClosed2 commits
MajorSub-taskHDFS-3211JournalProtocol changes required for introducing epoch and fencingSuresh SrinivasClosed4 commits
MajorBugHDFS-3222DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block.Uma Maheswara Rao GClosed2 commits
MajorImprovementHDFS-3226Allow GetConf tool to print arbitrary keysTodd LipconClosed4 commits
MajorImprovementHDFS-3238ServerCommand and friends don't need to be writablesEli CollinsClosed2 commits
MajorImprovementHDFS-3244Remove dead writable code from hdfs/protocolEli CollinsClosed2 commits
MajorBugHDFS-3254Branch-2 build broken due to wrong version number in fuse-dfs' pom.xmlAnupam SethClosed1 commit
MajorBugHDFS-3256HDFS considers blocks under-replicated if topology script is configured with only 1 rackAaron T. MyersClosed3 commits
MajorImprovementHDFS-3259NameNode#initializeSharedEdits should populate shared edits dir with edit log segmentsAaron T. MyersClosed2 commits
MajorBugHDFS-3260TestDatanodeRegistration should set minimum DN version in addition to minimum NN versionAaron T. MyersClosed2 commits
MajorImprovementHDFS-3263HttpFS should read HDFS config from Hadoop site.xml filesAlejandro AbdelnurClosed2 commits
MajorSub-taskHDFS-3282Add HdfsDataInputStream as a public APIUma Maheswara Rao GClosed3 commits
MajorBugHDFS-3286When the threshold value for balancer is 0(zero) ,unexpected output is displayedAshish SinghiClosed2 commits
MajorSub-taskHDFS-3298Add HdfsDataOutputStream as a public APITsz Wo Nicholas SzeClosed3 commits
MajorBugHDFS-3305GetImageServlet should consider SBN a valid requestor in a secure HA setupAaron T. MyersClosed2 commits
MajorBugHDFS-3309HttpFS (Hoop) chmod not supporting octal and sticky bit permissionsAlejandro AbdelnurClosed2 commits
MajorBugHDFS-3314HttpFS operation for getHomeDirectory is incorrectAlejandro AbdelnurClosed2 commits
MajorSub-taskHDFS-3322Update file context to use HdfsDataInputStream and HdfsDataOutputStreamTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3332NullPointerException in DN when directoryscanner is trying to report bad blocksamithClosed2 commits
MajorBugHDFS-3350findbugs warning: INodeFileUnderConstruction doesn't override INodeFile.equals(Object)Tsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-3351NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabledAaron T. MyersClosed2 commits
MajorBugHDFS-3395NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0Aaron T. MyersClosed3 commits
MinorWishHDFS-860fuse-dfs truncate behavior causes issues with scpBrian BockelmanClosed2 commits
MinorBugHDFS-891DataNode no longer needs to check for dfs.network.scriptHarsh JClosed2 commits
MinorImprovementHDFS-2410Further clean up hard-coded configuration keysSuresh SrinivasClosed3 commits
MinorImprovementHDFS-2564Cleanup unnecessary exceptions thrown and unnecessary castsHari MankudeClosed3 commits
MinorImprovementHDFS-2650Replace @inheritDoc with @Override Hari MankudeClosed2 commits
MinorImprovementHDFS-2708Stats for the # of blocks per DNAaron T. MyersClosed2 commits
MinorImprovementHDFS-3050rework OEV to share more code with the NameNodeColin P. McCabeClosed2 commits
MinorBugHDFS-3119Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that fileAshish SinghiClosed3 commits
MinorTestHDFS-3129NetworkTopology: add test that getLeaf should check for invalid topologiesColin P. McCabeClosed4 commits
MinorBugHDFS-3132Findbugs warning on HDFS trunkTodd LipconClosed2 commits
MinorNew FeatureHDFS-3167CLI-based driver for MiniDFSClusterHenry RobinsonClosed2 commits
MinorImprovementHDFS-3169TestFsck should test multiple -move operations in a rowColin P. McCabeClosed2 commits
MinorBugHDFS-3181testHardLeaseRecoveryAfterNameNodeRestart fails when length before restart is 1 byte less than CRC chunk sizeTsz Wo Nicholas SzeClosed2 commits
MinorSub-taskHDFS-3187Upgrade guava to 11.0.2Todd LipconClosed3 commits
MinorImprovementHDFS-3206Miscellaneous xml cleanups for OEVColin P. McCabeClosed2 commits
MinorBugHDFS-3236NameNode does not initialize generic conf keys when started with -initializeSharedEditsDirAaron T. MyersClosed2 commits
MinorImprovementHDFS-3247Improve bootstrapStandby behavior when original NN is not activeTodd LipconClosed2 commits
MinorBugHDFS-3248bootstrapstanby repeated twice in hdfs namenode usage messageColin P. McCabeClosed2 commits
MinorImprovementHDFS-3279One of the FSEditLog constructors should be moved to TestEditLogArpit GuptaClosed2 commits
MinorBugHDFS-3284bootstrapStandby fails in secure clusterTodd LipconClosed2 commits
MinorBugHDFS-3303RemoteEditLogManifest doesn't need to implements WritableBrandon LiClosed2 commits
MinorImprovementHDFS-3319DFSOutputStream should not start a thread in constructorsTsz Wo Nicholas SzeClosed2 commits
MinorBugHDFS-3328NPE in DataNode.getIpcPortEli CollinsClosed3 commits
MinorBugHDFS-3336hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.loggerRoman ShaposhnikClosed1 commit
MinorSub-taskHDFS-3339change INode to package privateJohn GeorgeClosed2 commits
MinorSub-taskHDFS-3363blockmanagement should stop using INodeFile & INodeFileUC John GeorgeClosed4 commits
MinorImprovementHDFS-3365Enable users to disable socket caching in DFS client configurationTodd LipconClosed2 commits
MinorBugHDFS-3396FUSE build fails on Ubuntu 12.04Colin P. McCabeClosed3 commits
MinorImprovementHDFS-3418Rename BlockWithLocationsProto datanodeIDs field to storageIDsEli CollinsClosed3 commits
TrivialImprovementHDFS-3003Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString()Brandon LiClosed3 commits
TrivialImprovementHDFS-3036Remove unused method DFSUtil#isDefaultNamenodeAddressAaron T. MyersClosed3 commits
TrivialBugHDFS-3038Add FSEditLog.metrics to findbugs exclude listTodd LipconClosed2 commits
TrivialTaskHDFS-3111Missing license headers in trunkUma Maheswara Rao GClosed4 commits
TrivialImprovementHDFS-3172dfs.upgrade.permission is dead codeEli CollinsClosed2 commits
TrivialBugHDFS-3234Accidentally left log message in GetConf after HDFS-3226Todd LipconClosed2 commits
TrivialImprovementHDFS-3240Drop log level of "heartbeat: ..." in BPServiceActor to DEBUGTodd LipconClosed2 commits
TrivialImprovementHDFS-3249Use ToolRunner.confirmPrompt in NameNodeTodd LipconClosed2 commits
TrivialImprovementHDFS-3294Fix indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethodsTsz Wo Nicholas SzeClosed2 commits
TrivialBugHDFS-3326Append enabled log message uses the wrong variableMatthew JacobsClosed2 commits
TrivialImprovementHDFS-3375Put client name in DataXceiver thread name for readBlock and keepaliveTodd LipconClosed2 commits
TrivialImprovementHDFS-3378Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULTEli CollinsClosed2 commits
1185 of 185