Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-737

High Availability support for Hadoop

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None
    • HA, High Availability

    Description

      Currently, We look at the HA of Hadoop cluster. We need to consider the NameNode HA as well as Jobtracker HA. For NameNode, we want to build primary/standy or master-slaves pattern to provide NameNode HA. Therefore, we need to consider how to ship log between primary/standby/slaves and how commit "write" operation to NameNode after the agreement among primary/standby/slaves on log. Whether will we use Linux HA package or NameNode-built-in HA package without the help of outter Linux HA package.
      After NameNode become high availability, is it necessary to provide HA for Jobtracker? Can Jobtracker persist the states of Jobs and tasks into HA NameNode? Or Jobtracker also needs the same approach from NameNode for HA support.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-2288 JT Availability

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-243 Namenode cluster(multi namenode working in active-active mode) to keep high availability and expansivity

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              qiujie Jie Qiu
              Votes:
              1 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: