Issue Details (XML | Word | Printable)

Key: MAPREDUCE-737
Type: New Feature New Feature
Status: Open Open
Priority: Major Major
Assignee: Unassigned
Reporter: Jie Qiu
Votes: 1
Watchers: 32
Operations

If you were logged in you would be able to see more operations.
Hadoop Map/Reduce

High Availability support for Hadoop

Created: 30/Jun/09 10:05 AM   Updated: 08/Jul/09 04:35 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: None

Time Tracking:
Not Specified

Issue Links:
Reference
 

Tags: HA, High Availability


 Description  « Hide
Currently, We look at the HA of Hadoop cluster. We need to consider the NameNode HA as well as Jobtracker HA. For NameNode, we want to build primary/standy or master-slaves pattern to provide NameNode HA. Therefore, we need to consider how to ship log between primary/standby/slaves and how commit "write" operation to NameNode after the agreement among primary/standby/slaves on log. Whether will we use Linux HA package or NameNode-built-in HA package without the help of outter Linux HA package.
After NameNode become high availability, is it necessary to provide HA for Jobtracker? Can Jobtracker persist the states of Jobs and tasks into HA NameNode? Or Jobtracker also needs the same approach from NameNode for HA support.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
No work has yet been logged on this issue.