[HDFS-3042] Automatic failover support for NN HA

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.2-alpha
• Component/s: auto-failover, ha
• Target Version/s: Auto failover (HDFS-3042)
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon Assign to me
• Reporter: Todd Lipcon
• Created: 02/Mar/12 22:47
• Updated: 11/Oct/12 17:46
• Resolved: 07/Jun/12 21:39

Description

HDFS-1623 was the umbrella task for implementation of NN HA capabilities. However, it only focused on manually-triggered failover.

Given that the HDFS-1623 branch will be merged shortly, I'm opening this JIRA to consolidate/track subtasks for automatic failover support and related improvements.

Issue Links

• incorporates: HADOOP-8206 Common portion of ZK-based failover controller
• incorporates: HADOOP-8212 Improve ActiveStandbyElector's behavior when session expires
• incorporates: HADOOP-8279 Auto-HA: Allow manual failover to be invoked from zkfc.
• is blocked by: HADOOP-7788 HA: Simple HealthMonitor class to watch an HAService
• is depended upon by: HDFS-3278 Umbrella Jira for HDFS-HA Phase 2
• is related to: HADOOP-8217 Edge case split-brain race in ZK-based auto-failover
• is related to: HADOOP-8215 Security support for ZK Failover controller

Sub-Tasks

• HA: HDFS portion of ZK-based FailoverController: Resolved
• Document NN auto-failover setup and configuration: Resolved
• Auto-HA: Scope all ZKFC configs by nameservice: Resolved
• Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs: Resolved
• ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception: Resolved
• Fix findbugs warnings in auto-HA branch: Resolved