Bulk Operation

HDFS-1623 HA: Address findbugs and javadoc warnings on branch

HDFS-1623 HA: fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS

HDFS-1623 HA: Implement a simple NN health check

HDFS-1623 HA: NameNode format doesn't pick up dfs.namenode.name.dir.NameServiceId configure

HDFS-1623 Get performance on HA branch to match trunk

HDFS-1623 HA: BackupNode#checkOperation should permit CHECKPOINT operations

HDFS-1623 HA: Balancer should use logical uri for creating failover proxy with HA enabled.

HDFS-1623 HA: TestBalancerWithHANameNodes is failing

HDFS-1623 HA: MiniDFSCluster does not delete standby NN name dirs during format

HDFS-1623 HA: re-enable NO_ACK optimization for block deletion

HDFS-1623 HA: small optimization building incremental block report

HDFS-1623 HA: TestDFSUtil is failing

HDFS-1623 HA: Sweep for remaining proxy construction which doesn't go through failover path

HDFS-1623 HA: IllegalStateException during standby startup in getCurSegmentTxId

HDFS-1623 HA: NN should not start with upgrade option or with a pending an unfinalized upgrade

HDFS-1623 HA: NN throws NPE during shutdown if it fails to startup

HDFS-1623 HA: On startup NN throws an NPE in the metrics system

HDFS-1623 HA: TestActiveStandbyElectorRealZK fails if build dir does not exist

HDFS-1623 HA: NullPointerException while formatting NameNode(After Configuring HA)

HDFS-1623 HA: TestHAStateTransitions fails on Windows

HDFS-1623 HA: TestDFSHAAdmin needs tests with MiniDFSCluster

HDFS-1623 HA: Shared edits dir property should be suffixed with nameservice and namenodeID

HDFS-1623 HA: Allow configs to be scoped to all NNs in the nameservice

HDFS-1623 HA: stress test and fixes for block synchronization

HDFS-1623 HA: ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy

HDFS-1623 HA: enable hadoop security authorization for haadmin / protocols

HDFS-1623 HA: Standby checkpointing fails to authenticate in secure cluster

HDFS-1623 HA: close out operation categories

HDFS-1623 HA: fix remaining TODO items

HDFS-1623 HA: haadmin should not work if run by regular user

HDFS-1623 HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition

HDFS-1623 HA: Namenode not shutting down when shared edits dir is inaccessible

HDFS-1623 HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

HDFS-1623 HA: Standby NN NPE when shared edits dir is deleted

HDFS-1623 HA: Client support for getting delegation tokens to an HA cluster

HDFS-1623 HA: NPE if shared edits directory is not available during failover

HDFS-1623 HA: Improvements for SBN web UI - not show under-replicated/missing blocks

HDFS-1623 HA: automatically determine the nameservice Id if only one nameservice is configured

HDFS-1623 HA: DFSUtil#getSuffixIDs should skip unset configurations

HDFS-1623 HA: edit log should log to shared dirs before local dirs

HDFS-1623 HA: Remove some INFO level logging accidentally left around

HDFS-1623 Standby does not start up due to a gap in transaction id

HDFS-1623 Standby namenode gets a "cannot lock storage" exception during startup

HDFS-1623 Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

HDFS-1623 HA: checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN

HDFS-1623 HA: TestDFSRollback#testRollback is failing

HDFS-1623 LOCAL_ADDRESS_MATCHER.match has NPE when called from DFSUtil.getSuffixIDs when the host is incorrect

HDFS-1623 DFSUtil.getSuffixIDs silently ignores exception in NetUtils.createSocketAddr

HDFS-1623 HA: NN fails to start if the shared edits dir is marked required

HDFS-1623 SBN should not allow browsing of the file system via web UI

HDFS-1623 HA: TestSafeMode#testNoExtensionIfNoBlocks is failing

HDFS-1623 HA: HAAdmin does not work if security is enabled

HDFS-1623 HA: NPE in FSNamesystem when in safe mode

HDFS-1623 HA: Fix ConfiguredFailoverProxyProvider for federation

HDFS-1623 HA: failover does not succeed if prior NN died just after creating an edit log segment

HDFS-1623 HA: Transition to active can cause NN deadlock

HDFS-1623 Add a simple sanity check for HA config

HDFS-1623 Document new HA-related configs in hdfs-default.xml

HDFS-1623 When becoming active, NN should treat all leases as freshly renewed

HDFS-1623 HA: Client should fail if a failover occurs which switches block pool ID

HDFS-1623 Add test to verify that delegation tokens are honored after failover.

HDFS-1623 HA: haadmin should use namenode ids

HDFS-1623 Service level authorizartion for HAServiceProtocol

HDFS-1623 ConfiguredFailoverProxyProvider should be moved to common.

HDFS-1623 HA: Add a test for a federated cluster with HA NNs

HDFS-1623 SBN should not mark blocks under-replicated when exiting safemode

HDFS-1623 TestDFSClientFailover shuold use simpleHATopology.

HDFS-1623 HA: Standby NN takes a long time to recover from a dead DN starting up

HDFS-1623 HA: Active NN may purge edit log files before standby NN has a chance to read them

HDFS-1623 HA: Make fsck work

HDFS-1623 TestHAAdmin.testFailover is failing

HDFS-1623 HA: Add lease recovery handling to HA

HDFS-1623 HA: TestStandbyCheckpoints.testBothNodesInStandbyState fails intermittently

HDFS-1623 HA: reading edit logs from an earlier version leaves blocks in under-construction state

HDFS-1623 HA: On transition to active, standby should not swallow ELIE

HDFS-1623 HA: When HA is enabled with a shared edits dir, that dir should be marked required

HDFS-1623 HA: ConfiguredFailoverProxyProvider should support NameNodeProtocol

HDFS-1623 HA: test for case where standby partially reads log and then performs checkpoint

HDFS-1623 TestCheckpoint is timing out

HDFS-1623 Warm standby does not read the in_progress edit log

HDFS-1623 Standby namenode stuck in safemode during a failover

HDFS-1623 HA: exit if multiple shared dirs are configured

HDFS-1623 HA: entering safe mode after starting SBN can NPE

HDFS-1623 HA: observed dataloss in replication stress test

HDFS-1623 FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested

HDFS-1623 HA: Automatically trigger log rolls periodically on the active NN

HDFS-1623 HA: support 2NN with SBN

HDFS-1623 HA: add tests for multiple shared edits dirs

HDFS-1623 Document HA configuration and CLI

HDFS-1623 Add support for the standby in the bin scripts

HDFS-1623 HA: Refactor shared HA-related test code into HATestUtils class

HDFS-1623 NN web UI can throw NPE after startup, before standby state is entered

HDFS-1623 HA : TestStandbyIsHot is failing while copying in_use.lock file from NN1 nameSpaceDirs to NN2 nameSpaceDirs

HDFS-1623 HA: Configuration needs to allow different dfs.http.addresses for each HA NN

HDFS-1623 HA: Fix test cases which use standalone FSNamesystems

HDFS-1623 HA : An alternative approach to clients handling Namenode failover.

HDFS-1623 HA: Appropriately handle error conditions in EditLogTailer

HDFS-1623 Synchronization issues around state transition

HDFS-1623 HA: Bugs related to failover from/into safe-mode

HDFS-1623 HA: Tests and fixes for pipeline targets and replica recovery

HDFS-1623 HA: BookKeeperEditLogInputStream doesn't implement isInProgress()

HDFS-1623 HA: write tests for quota tracking and HA

HDFS-1623 Fix up some failing unit tests on HA branch

HDFS-1623 Authority-based lookup of proxy provider fails if path becomes canonicalized

HDFS-1623 HA: When a FailoverProxyProvider is used, Client should not retry for 45 times(hard coded value) if it is timing out to connect to server.

HDFS-1623 DFSClient should construct failover proxy with exponential backoff

HDFS-1623 Add interface to query current state to HAServiceProtocol

HDFS-1623 HA: When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over

HDFS-1623 HA: Web UI should indicate the NN state

HDFS-1623 HA: NN should throw StandbyException in response to RPCs in STANDBY state

HDFS-1623 HA: Fix NN Active->Standby transition

HDFS-1623 Standby needs to ingest latest edit logs before transitioning to active`

HDFS-1623 HA: determine DN's view of which NN is active based on heartbeat responses

HDFS-1623 HA: BPOfferService.verifyAndSetNamespaceInfo needs to be synchronized

HDFS-1623 HA: TestDfsOverAvroRpc failing after introduction of HeartbeatResponse type

HDFS-1623 HA: ConfiguredFailoverProxyProvider doesn't correctly stop ProtocolTranslators

HDFS-1623 HA: Add test case for hot standby capability

HDFS-1623 HA: fix TestDFSUpgrade on HA branch

HDFS-1623 Change DatanodeProtocol#sendHeartbeat to return HeartbeatResponse

HDFS-1623 HA: handle refreshNameNodes in federated HA clusters

HDFS-1623 HA: don't initialize replication queues until entering Active mode

HDFS-1623 NN should log newly-allocated blocks without losing BlockInfo

HDFS-1623 HA: Balancer support for HA namenodes

HDFS-1623 HA: MiniDFSCluster support to mix and match federation with HA

HDFS-1623 Add protobuf service and implementation for HAServiceProtocol

HDFS-1623 Scope dfs.ha.namenodes config by nameservice

HDFS-1623 Starting delegation token manager during safemode fails

HDFS-1623 HA: NN fails to start since it tries to start secret manager in safemode

HDFS-1623 NameNode needs to add HAServiceProtocol to its RPC Server

HDFS-1623 Add HA-related metrics

HDFS-1623 Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231

HDFS-1623 getServerDefaults and getStats don't check operation category

HDFS-1623 Add tests for Namenode active standby states

HDFS-1623 Mark appropriate methods of ClientProtocol with the idempotent annotation

HDFS-1623 HA: Enable the configuration of multiple HA cluster addresses

HDFS-1623 Generalize the HAServiceProtocol interface

HDFS-1623 Start/stop appropriate namenode internal services during transition to active and standby

HDFS-1623 HA: Checkpointing in an HA setup

HDFS-1623 Configuration changes for HA namenode

HDFS-1623 Merge NameNode roles into NodeType.

HDFS-1623 Remove NameNode roles Active and Standby (they become states)

HDFS-1623 Client should not timeout during a NN start - esp useful for HA NN

HDFS-1623 HA: Support for sharing the namenode state from active to standby.

HDFS-1623 HA: Introduce active and standby states to the namenode

HDFS-1623 HA: HDFS clients must handle namenode failover and switch over to the new active namenode.

HDFS-1623 HA: Datanode fencing mechanism

HDFS-1623 HA: Send block report from datanode to both active and standby namenodes

HDFS-1623 Log newly allocated blocks