Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7454

Common side of High Availability Framework (HDFS-1623)

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0-alpha
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There will likely need to be a few changes to Hadoop Common (e.g. HDFS-7380) to complete HDFS-1623 (High Availability Framework for HDFS NN). This JIRA is an umbrella for those Common changes.

        Attachments

          Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. HDFS-1623 High Availability Framework for HDFS NN

          • Major - Major loss of function.
          • Closed
          1.
          		 Add client failover functionality to o.a.h.io.(ipc|retry) Sub-task Closed Aaron Myers
          2.
          		 Introduce HA Service Protocol Interface Sub-task Resolved Suresh Srinivas
          3.
          		 HA: Administrative CLI to control HA daemons Sub-task Resolved Todd Lipcon
          4.
          		 HA: if both NNs are in Standby mode, client needs to try failing back and forth several times with sleeps Sub-task Resolved Aaron Myers
          5.
          		 StandbyException should extend IOException Sub-task Resolved Todd Lipcon
          6.
          		 HA: Improve some logging for client IPC failovers and StandbyExceptions Sub-task Resolved Todd Lipcon
          7.
          		 
FailoverController for client-based configuration Sub-task Resolved Eli Collins
          8.
          		 Add interface and update CLI to query current state to HAServiceProtocol Sub-task Resolved Eli Collins
          9.
          		 HA: Client failover policy is incorrectly trying to fail over all IOExceptions Sub-task Resolved Aaron Myers
          10.
          		 HA : Make client connection retries on socket time outs configurable. Sub-task Resolved Uma Maheswara Rao G
          11.
          		 HA: the FailoverController should optionally fence the active during failover Sub-task Resolved Eli Collins
          12.
          		 HA: failover should error out if either host is not specified in the configs Sub-task Resolved Eli Collins
          13.
          		 HA: fencing mechanism Sub-task Resolved Todd Lipcon
          14.
          		 All HAServiceProtocol methods have to throw IOException since they are invoked over the network Sub-task Resolved Hari Mankude
          15.
          		 HA: failover should be able to pass args to fencers Sub-task Resolved Eli Collins
          16.
          		 HA: the FailoverController should check the standby is ready before failing over Sub-task Resolved Eli Collins
          17.
          		 HA: Add 'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml file. Sub-task Resolved Uma Maheswara Rao G
          18.
          		 HA: log a warning when a failover is first attempted Sub-task Resolved Todd Lipcon
          19.
          		 HA: void methods can swallow exceptions when going through failover path Sub-task Resolved Todd Lipcon
          20.
          		 HA: RetriableCommand is using RetryPolicy incorrectly after HADOOP-7896 Sub-task Resolved Aaron Myers
          21.
          		 HA: HAServiceProtocol exceptions need to be unwrapped before it can be used Sub-task Resolved Hari Mankude
          22.
          		 Add ZK client for leader election Sub-task Resolved Bikas Saha

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                atm Aaron Myers
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: