[MAPREDUCE-737] High Availability support for Hadoop

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Tags: HA, High Availability
• Assignee: Unassigned
• Reporter: Jie Qiu
• Created: 30/Jun/09 10:05
• Updated: 23/Jul/14 18:31
• Resolved: 23/Jul/14 18:31

Description

Currently, We look at the HA of Hadoop cluster. We need to consider the NameNode HA as well as Jobtracker HA. For NameNode, we want to build primary/standy or master-slaves pattern to provide NameNode HA. Therefore, we need to consider how to ship log between primary/standby/slaves and how commit "write" operation to NameNode after the agreement among primary/standby/slaves on log. Whether will we use Linux HA package or NameNode-built-in HA package without the help of outter Linux HA package.
After NameNode become high availability, is it necessary to provide HA for Jobtracker? Can Jobtracker persist the states of Jobs and tasks into HA NameNode? Or Jobtracker also needs the same approach from NameNode for HA support.

Issue Links

• is related to: MAPREDUCE-2288 JT Availability
• relates to: HDFS-243 Namenode cluster(multi namenode working in active-active mode) to keep high availability and expansivity