Version 2.0.2-alpha


Start date not set

Released: 09/Oct/12

Release Notes

2.0.2-alpha releaseShow more
BlockerBugHDFS-3312Hftp selects wrong token serviceDaryn SharpClosed3 commits
BlockerBugHDFS-3318Hftp hangs on transfers >2GBDaryn SharpClosed5 commits
BlockerSub-taskHDFS-3452BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lockUma Maheswara Rao GClosed2 commits
BlockerBugHDFS-3577WebHdfsFileSystem can not read files larger than 24KBTsz Wo Nicholas SzeClosed6 commits
BlockerBugHDFS-37312.0 release upgrade must handle blocks being written from 1.0Kihwal LeeClosed3 commits
BlockerBugHDFS-3856TestHDFSServerPorts failure is causing surefire fork failureEli CollinsClosed4 commits
BlockerBugHDFS-3861Deadlock in DFSClientKihwal LeeClosed3 commits
CriticalBugHDFS-2982Startup performance suffers when there are many edit log segmentsColin P. McCabeClosed2 commits
CriticalBugHDFS-3166Hftp connections do not have a timeoutDaryn SharpClosed3 commits
CriticalBugHDFS-3308hftp/webhdfs can't get tokens if authority has no portDaryn SharpClosed5 commits
CriticalBugHDFS-3359DFSClient.close should close cached socketsTodd LipconClosed3 commits
CriticalBugHDFS-3391TestPipelinesFailover#testLeaseRecoveryAfterFailover is failingTodd LipconClosed2 commits
CriticalBugHDFS-3413TestFailureToReadEdits timing outAaron T. MyersClosed2 commits
CriticalBugHDFS-3460HttpFS proxyuser validation with Kerberos ON uses full principal nameAlejandro AbdelnurClosed2 commits
CriticalBugHDFS-3548NamenodeFsck.copyBlock fails to create a Block ReaderColin P. McCabeClosed2 commits
CriticalBugHDFS-3646LeaseRenewer can hold reference to inactive DFSClient instances foreverKihwal LeeClosed5 commits
CriticalBugHDFS-3696Create files with WebHdfsFileSystem goes OOM when file size is bigTsz Wo Nicholas SzeClosed7 commits
CriticalBugHDFS-3718Datanode won't shutdown because of runaway DataBlockScanner threadKihwal LeeClosed4 commits
CriticalBugHDFS-3721hsync support broke wire compatibilityAaron T. MyersClosed2 commits
CriticalBugHDFS-3756DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configuredAlejandro AbdelnurClosed2 commits
CriticalBugHDFS-3788distcp can't copy large files using webhdfs due to missing Content-Length headerTsz Wo Nicholas SzeClosed5 commits
CriticalBugHDFS-3808fuse_dfs: postpone libhdfs intialization until after forkColin P. McCabeClosed2 commits
CriticalBugHDFS-3849When re-loading the FSImage, we should clear the existing genStamp and leases.Colin P. McCabeClosed2 commits
CriticalBugHDFS-3890filecontext mkdirs doesn't apply umask as expectedThomas GravesClosed4 commits
CriticalBugHDFS-3972Trash emptier fails in secure HA clusterTodd LipconClosed3 commits
MajorBugHDFS-711hdfsUtime does not handle atime = 0 or mtime = 0 correctlyColin P. McCabeClosed2 commits
MajorNew FeatureHDFS-744Support hsync in HDFSLars HofhanslClosed3 commits
MajorImprovementHDFS-799libhdfs must call DetachCurrentThread when a thread is destroyedColin P. McCabeClosed4 commits
MajorBugHDFS-2285BackupNode should reject requests trying to modify namespaceKonstantin ShvachkoClosed4 commits
MajorSub-taskHDFS-2330In, IOExceptions of stream closures can mask root exceptions.Uma Maheswara Rao GClosed3 commits
MajorImprovementHDFS-2391Newly set BalancerBandwidth value is not displayed anywhereHarsh JClosed2 commits
MajorImprovementHDFS-2421Improve the concurrency of SerialNumberMap in NameNodeJing ZhaoClosed3 commits
MajorImprovementHDFS-2617Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solutionJakob HomanClosed5 commits
MajorBugHDFS-2619Remove my personal email address from the libhdfs build file.Owen O'MalleyClosed
MajorImprovementHDFS-2652Port token service changes from 205Daryn SharpClosed3 commits
MajorImprovementHDFS-2686Remove DistributedUpgrade related codeSuresh SrinivasClosed3 commits
MajorSub-taskHDFS-2717BookKeeper Journal output stream doesn't check addComplete rcIvan KellyClosed3 commits
MajorBugHDFS-2757Cannot read a local block that's being written to when using the local read short circuitJean-Daniel CryansClosed5 commits
MajorBugHDFS-2759Pre-allocate HDFS edit log files after writing version numberAaron T. MyersClosed3 commits
MajorNew FeatureHDFS-2793Add an admin command to trigger an edit log rollTodd LipconClosed2 commits
MajorBugHDFS-2797Fix misuses of InputStream#skip in the edit log codeColin P. McCabeClosed2 commits
MajorBugHDFS-2800HA: TestStandbyCheckpoints.testCheckpointCancellation is racyTodd LipconClosed2 commits
MajorImprovementHDFS-2834ByteBuffer-based read API for DFSInputStreamHenry RobinsonClosed2 commits
MajorImprovementHDFS-2885Remove "federation" from the nameservice config optionsTsz Wo Nicholas SzeClosed2 commits
MajorBugHDFS-2914HA: Standby should not enter safemode when resources are lowVinayakumar BClosed2 commits
MajorNew FeatureHDFS-2978The NameNode should expose name dir statuses via JMXAaron T. MyersClosed5 commits
MajorBugHDFS-3031HA: Fix complete() and getAdditionalBlock() RPCs to be idempotent.Todd LipconClosed2 commits
MajorNew FeatureHDFS-3042Automatic failover support for NN HATodd LipconClosed40 commits
MajorBugHDFS-3048Small race in BlockManager#closeAndy IsaacsonClosed2 commits
MajorBugHDFS-3054distcp -skipcrccheck has no effectColin P. McCabeClosed2 commits
MajorSub-taskHDFS-3058HA: Bring BookKeeperJournalManager up to date with HA changesIvan KellyClosed5 commits
MajorBugHDFS-3067NPE in DFSInputStream.readBuffer if read is repeated on corrupted blockHenry RobinsonClosed4 commits
MajorImprovementHDFS-3110libhdfs implementation of direct read APIHenry RobinsonClosed2 commits
MajorNew FeatureHDFS-3113httpfs does not support delegation tokensAlejandro AbdelnurClosed6 commits
MajorImprovementHDFS-3134Harden edit log loader against malformed or malicious inputColin P. McCabeClosed2 commits
MajorBugHDFS-3136Multiple SLF4J binding warningJason LoweClosed3 commits
MajorNew FeatureHDFS-3150Add option for clients to contact DNs via hostnameEli CollinsClosed4 commits
MajorBugHDFS-3157Error in deleting block is keep on coming from DN even after the block report and directory scanning has happenedAshish SinghiClosed7 commits
MajorSub-taskHDFS-3168Clean up FSNamesystem and BlockManagerTsz Wo Nicholas SzeClosed2 commits
MajorImprovementHDFS-3170Add more useful metrics for write latencyMatthew JacobsClosed2 commits
MajorBugHDFS-3176JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own.Kihwal LeeClosed4 commits
MajorBugHDFS-3177Allow DFSClient to find out and use the CRC type being used for a file.Kihwal LeeClosed3 commits
MajorBugHDFS-3194DataNode block scanner is running too frequentlyAndy IsaacsonClosed2 commits
MajorImprovementHDFS-3227Mavenise libhdfs testsUnassignedClosed
MajorBugHDFS-3243TestParallelRead timing out on jenkinsHenry RobinsonClosed2 commits
MajorTestHDFS-3258Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node)Junping DuClosed3 commits
MajorBugHDFS-3275Format command overwrites contents of non-empty shared edits dir if name dirs are empty without any promptingamithClosed2 commits
MajorTestHDFS-3291add test that covers HttpFS working w/ a non-HDFS Hadoop filesystemAlejandro AbdelnurClosed2 commits
MajorBugHDFS-3321Error message for insufficient data nodes to come out of safemode is wrong.Ravi PrakashClosed3 commits
MajorBugHDFS-3331setBalancerBandwidth do not checkSuperuserPrivilegeTsz Wo Nicholas SzeClosed3 commits
MajorBugHDFS-3334ByteRangeInputStream leaks streamsDaryn SharpClosed3 commits
MajorImprovementHDFS-3335check for edit log corruption at the end of the logColin P. McCabeClosed3 commits
MajorImprovementHDFS-3343Improve metrics for DN read latencyAndrew WangClosed2 commits
MajorBugHDFS-3368Missing blocks due to bad DataNodes coming up and down.Konstantin ShvachkoClosed3 commits
MajorBugHDFS-3385ClassCastException when trying to append a fileTsz Wo Nicholas SzeClosed2 commits
MajorSub-taskHDFS-3389Document the BKJM usage in Namenode HA.Uma Maheswara Rao GClosed4 commits
MajorImprovementHDFS-3400DNs should be able start with jsvc even if security is disabledAaron T. MyersClosed2 commits
MajorImprovementHDFS-3401Cleanup DatanodeDescriptor creation in the testsEli CollinsClosed2 commits
MajorImprovementHDFS-3404Make putImage in GetImageServlet infer remote address to fetch from requestAaron T. MyersClosed2 commits
MajorBugHDFS-3415During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are differentBrandon LiClosed2 commits
MajorSub-taskHDFS-3423BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodesIvan KellyClosed2 commits
MajorBugHDFS-3428move DelegationTokenRenewer to commonAlejandro AbdelnurClosed2 commits
MajorBugHDFS-3433GetImageServlet should allow administrative requestors when security is enabledAaron T. MyersClosed2 commits
MajorBugHDFS-3436adding new datanode to existing pipeline fails in case of Append/RecoveryVinayakumar BClosed3 commits
MajorImprovementHDFS-3438BootstrapStandby should not require a rollEdits on active nodeTodd LipconClosed2 commits
MajorSub-taskHDFS-3441Race condition between rolling logs at active NN and purging at standbyRakesh RClosed2 commits
MajorBugHDFS-3444hdfs groups command doesn't work with security enabledAaron T. MyersClosed2 commits
MajorBugHDFS-3446HostsFileReader silently ignores bad includes/excludesMatthew JacobsClosed2 commits
MajorBugHDFS-3466The SPNEGO filter for the NameNode should come out of the web keytab fileOwen O'MalleyClosed4 commits
MajorSub-taskHDFS-3468Make BKJM-ZK session timeout configurable.Uma Maheswara Rao GClosed2 commits
MajorSub-taskHDFS-3474Cleanup Exception handling in BookKeeper journal managerIvan KellyClosed2 commits
MajorBugHDFS-3480Multiple SLF4J binding warningVinayakumar BClosed2 commits
MajorImprovementHDFS-3481Refactor HttpFS handling of JAX-RS query string parametersAlejandro AbdelnurClosed3 commits
MajorBugHDFS-3491HttpFs does not set permissions correctlyAlejandro AbdelnurClosed1 commit
MajorBugHDFS-3501Checkpointing with security enabled will stop working after ticket lifetime expiresAaron T. MyersClosed2 commits
MajorSub-taskHDFS-3502Change INodeFile and INodeFileUnderConstruction to package privateTsz Wo Nicholas SzeClosed
MajorImprovementHDFS-3504Configurable retry in DFSClientTsz Wo Nicholas SzeClosed4 commits
MajorImprovementHDFS-3513HttpFS should cache filesystemsAlejandro AbdelnurClosed2 commits
MajorImprovementHDFS-3514Add missing TestParallelLocalReadHenry RobinsonClosed2 commits
MajorImprovementHDFS-3516Check content-type in WebHdfsFileSystemTsz Wo Nicholas SzeClosed5 commits
MajorBugHDFS-3518Provide API to check HDFS operational stateTsz Wo Nicholas SzeClosed4 commits
MajorBugHDFS-3522If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locationsBrandon LiClosed6 commits
MajorBugHDFS-3524TestFileLengthOnClusterRestart failed due to error message changeBrandon LiClosed2 commits
MajorNew FeatureHDFS-3535Audit logging should log denied accessesAndy IsaacsonClosed2 commits
MajorBugHDFS-3541Deadlock between recovery, xceiver and packet responderVinayakumar BClosed3 commits
MajorBugHDFS-3551WebHDFS CREATE does not use client location for redirectionTsz Wo Nicholas SzeClosed4 commits
MajorBugHDFS-3555idle client socket triggers DN ERROR log (should be INFO or DEBUG)Andy IsaacsonClosed2 commits
MajorImprovementHDFS-3568fuse_dfs: add support for securityColin P. McCabeClosed2 commits
MajorBugHDFS-3579libhdfs: fix exception handlingColin P. McCabeClosed3 commits
MajorBugHDFS-3581FSPermissionChecker#checkPermission sticky bit check missing range check Eli CollinsClosed3 commits
MajorImprovementHDFS-3583Convert remaining tests to Junit4Andrew WangClosed3 commits
MajorBugHDFS-3591Backport HDFS-3357 to branch-0.23Robert Joseph EvansClosed1 commit
MajorBugHDFS-3603Decouple TestHDFSTrash from TestTrashJason LoweClosed3 commits
MajorBugHDFS-3605Block mistakenly marked corrupt during edit log catchup phase of failoverTodd LipconClosed2 commits
MajorBugHDFS-3609libhdfs: don't force the URI to look like hdfs://hostname:portColin P. McCabeClosed2 commits
MajorBugHDFS-3615Two BlockTokenSecretManager findbugs warningsAaron T. MyersClosed2 commits
MajorBugHDFS-3622Backport HDFS-3541 to branch-0.23Robert Joseph EvansClosed1 commit
MajorNew FeatureHDFS-3637Add support for encrypting the DataTransferProtocolAaron T. MyersClosed2 commits
MajorImprovementHDFS-3650Use MutableQuantiles to provide latency histograms for various operationsAndrew WangClosed2 commits
MajorImprovementHDFS-3654TestJspHelper#testGetUgi fails with NPEEli CollinsClosed7 commits
MajorBugHDFS-3658TestDFSClientRetries#testNamenodeRestart failedTsz Wo Nicholas SzeClosed4 commits
MajorImprovementHDFS-3663MiniDFSCluster should capture the code path that led to the first ExitException Eli CollinsClosed2 commits
MajorBugHDFS-3664BlockManager race when stopping active servicesColin P. McCabeClosed3 commits
MajorTestHDFS-3665Add a test for renaming across file systems via a symlinkEli CollinsClosed2 commits
MajorImprovementHDFS-3672Expose disk-location information for blocks to enable better schedulingAndrew WangClosed4 commits
MajorBugHDFS-3688Namenode loses datanode hostname if datanode re-registersJason LoweClosed1 commit
MajorBugHDFS-3690BlockPlacementPolicyDefault incorrectly casts LOGEli CollinsClosed3 commits
MajorTestHDFS-3709TestStartup tests still binding to the ephemeral port Eli CollinsClosed2 commits
MajorImprovementHDFS-3711Manually convert remaining tests to JUnit4Andrew WangClosed2 commits
MajorBugHDFS-3715Fix TestFileCreation#testFileCreationNamenodeRestartAndrew WangClosed2 commits
MajorBugHDFS-3717Test cases in TestPBHelper failKihwal LeeClosed
MajorBugHDFS-3720hdfs.h must get packagedColin P. McCabeClosed2 commits
MajorImprovementHDFS-3723All commands should support meaningful --helpJing ZhaoClosed4 commits
MajorBugHDFS-3724add InterfaceAudience annotations to HttpFS classes and making inner enum staticAlejandro AbdelnurClosed2 commits
MajorBugHDFS-3733Audit logs should include WebHDFS accessAndy IsaacsonClosed2 commits
MajorBugHDFS-3754BlockSender doesn't shutdown ReadaheadPool threadsEli CollinsClosed3 commits
MajorBugHDFS-3755Creating an already-open-for-write file with overwrite=true failsTodd LipconClosed2 commits
MajorImprovementHDFS-3765Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storagesVinayakumar BClosed2 commits
MajorBugHDFS-3794WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.Ravi PrakashClosed5 commits
MajorBugHDFS-3816Invalidate work percentage default value should be 0.32f instead of 32Jing ZhaoClosed2 commits
MajorBugHDFS-3832Remove protocol methods related to DistributedUpgradeSuresh SrinivasClosed3 commits
MajorBugHDFS-3833TestDFSShell fails on Windows due to file concurrent read writeBrandon LiClosed3 commits
MajorBugHDFS-3835Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokensAaron T. MyersClosed3 commits
MajorBugHDFS-3837Fix DataNode.recoverBlock findbugs warningEli CollinsClosed6 commits
MajorBugHDFS-3841Port HDFS-3835 to branch-0.23Robert Joseph EvansClosed1 commit
MajorBugHDFS-3852TestHftpDelegationToken is broken after HADOOP-8225Daryn SharpClosed3 commits
MajorBugHDFS-3860HeartbeatManager#Monitor may wrongly hold the writelock of namesystemJing ZhaoClosed3 commits
MajorBugHDFS-3864NN does not update internal file mtime for OP_CLOSE when reading from the edit logAaron T. MyersClosed2 commits
MajorBugHDFS-3873Hftp assumes security is disabled if token fetch failsDaryn SharpClosed6 commits
MajorBugHDFS-3895hadoop-client must include commons-cliAlejandro AbdelnurClosed2 commits
MajorImprovementHDFS-3907Allow multiple users for local block readersEli CollinsClosed3 commits
MajorBugHDFS-3928MiniDFSCluster should reset the first ExitException on shutdownEli CollinsClosed3 commits
MinorBugHDFS-470libhdfs should handle 0-length reads from FSInputStream correctlyColin P. McCabeClosed2 commits
MinorBugHDFS-766Error message not clear for set space quota out of boundary values. Jon ZuanichClosed2 commits
MinorImprovementHDFS-1013Miscellaneous improvements to HTML markup for web UIsEugene KoontzClosed2 commits
MinorBugHDFS-1153dfsnodelist.jsp should handle invalid input parametersRavi PhulariClosed3 commits
MinorBugHDFS-1249with fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error.Colin P. McCabeClosed2 commits
MinorBugHDFS-1490TransferFSImage should timeoutVinayakumar BClosed2 commits
MinorBugHDFS-2025Go Back to File View link is not working in tail.jspAshish SinghiClosed2 commits
MinorImprovementHDFS-2727libhdfs should get the default block size from the serverColin P. McCabeClosed2 commits
MinorBugHDFS-2963Console Output is confusing while executing metasave (dfsadmin command) Andrew WangClosed2 commits
MinorBugHDFS-2966TestNameNodeMetrics tests can fail under loadSteve LoughranClosed2 commits
MinorImprovementHDFS-2988Improve error message when storage directory lock failsMiomir BoljanovicClosed2 commits
MinorBugHDFS-3037TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racyAaron T. MyersClosed3 commits
MinorSub-taskHDFS-3190Simple refactors in existing NN code to assist QuorumJournalManager extensionTodd LipconClosed3 commits
MinorImprovementHDFS-3230Cleanup DatanodeID creation in the testsEli CollinsClosed2 commits
MinorBugHDFS-3235MiniDFSClusterManager doesn't correctly support -format optionHenry RobinsonClosed2 commits
MinorBugHDFS-3266DFSTestUtil#waitCorruptReplicas doesn't sleep between checksmadhukara phatakClosed3 commits
MinorImprovementHDFS-3276initializeSharedEdits should have a -nonInteractive flagTodd LipconClosed2 commits
MinorBugHDFS-3306fuse_dfs: don't lock release operationsColin P. McCabeClosed2 commits
MinorImprovementHDFS-3341Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0Todd LipconClosed2 commits
MinorSub-taskHDFS-3369change variable names referring to inode in blockmanagement to more appropriateJohn GeorgeClosed2 commits
MinorImprovementHDFS-3372offlineEditsViewer should be able to read a binary edits file with recovery modeColin P. McCabeClosed2 commits
MinorImprovementHDFS-3390DFSAdmin should print full stack traces of errors when DEBUG logging is enabledAaron T. MyersClosed2 commits
MinorImprovementHDFS-3394Do not use generic in INodeFile.getLastBlock()Tsz Wo Nicholas SzeClosed2 commits
MinorBugHDFS-3398Client will not retry when primaryDN is down once it's just got pipelineamithClosed2 commits
MinorSub-taskHDFS-3408BKJM : Namenode format fails, if there is no BK rootRakesh RClosed4 commits
MinorBugHDFS-3414Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configsAaron T. MyersClosed2 commits
MinorImprovementHDFS-3416Cleanup DatanodeID and DatanodeRegistration constructors used by testing Eli CollinsClosed2 commits
MinorImprovementHDFS-3417Rename BalancerDatanode#getName to getDisplayName to be consistent with DatanodeEli CollinsClosed2 commits
MinorImprovementHDFS-3419Cleanup LocatedBlockEli CollinsClosed2 commits
MinorBugHDFS-3422TestStandbyIsHot timeouts too aggressiveTodd LipconClosed2 commits
MinorBugHDFS-3440should more effectively limit stream memory consumption when reading corrupt edit logsColin P. McCabeClosed2 commits
MinorBugHDFS-3442Incorrect count for Missing Replicas in FSCK reportAndrew WangClosed3 commits
MinorImprovementHDFS-3454Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled Eli CollinsClosed2 commits will start zkfc, but will not stop zkfc similarly.Vinayakumar BClosed2 commits
MinorBugHDFS-3484hdfs fsck doesn't work if NN HTTP address is set to even if NN RPC address is configuredAaron T. MyersClosed2 commits
MinorBugHDFS-3485DataTransferThrottler will over-throttle when currentTimeMillis jumpsAndy IsaacsonClosed2 commits
MinorBugHDFS-3486offlineimageviewer can't read fsimage files that contain persistent delegation tokensColin P. McCabeClosed3 commits
MinorBugHDFS-3487offlineimageviewer should give byte offset information when it encounters an exceptionColin P. McCabeClosed2 commits
MinorBugHDFS-3490DN WebHDFS methods throw NPE if Namenode RPC address param not specifiedTsz Wo Nicholas SzeClosed2 commits
MinorBugHDFS-3505DirectoryScanner does not join all threads in shutdownColin P. McCabeClosed2 commits
MinorBugHDFS-3517TestStartup should bind ephemeral portsEli CollinsClosed2 commits
MinorImprovementHDFS-3520Add transfer rate logging to TransferFsImageEli CollinsClosed2 commits
MinorBugHDFS-3531EditLogFileOutputStream#preallocate should check for incomplete writesColin P. McCabeClosed6 commits
MinorImprovementHDFS-3537Move libhdfs and fuse-dfs source to native subdirectoriesColin P. McCabeClosed2 commits
MinorBugHDFS-3539libhdfs code cleanupsColin P. McCabeClosed2 commits
MinorBugHDFS-3559DFSTestUtil: use Builder class to construct DFSTestUtil instancesColin P. McCabeClosed2 commits
MinorBugHDFS-3572Cleanup code which inits SPNEGO in HttpServerTodd LipconClosed2 commits
MinorBugHDFS-3574Fix small race and do some cleanup in GetImageServletTodd LipconClosed2 commits
1200 of 246