Hadoop Common
  1. Hadoop Common
  2. HADOOP-7454

Common side of High Availability Framework (HDFS-1623)

        Details

        • Type: New Feature New Feature
        • Status: Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 2.0.0-alpha
        • Component/s: None
        • Labels:
          None
        • Target Version/s:
        • Hadoop Flags:
          Reviewed

          Description

          There will likely need to be a few changes to Hadoop Common (e.g. HDFS-7380) to complete HDFS-1623 (High Availability Framework for HDFS NN). This JIRA is an umbrella for those Common changes.

            Issue Links

            blocks

            New Feature - A new feature of the product, which has yet to be developed. HDFS-1623 High Availability Framework for HDFS NN

            • Major - Major loss of function.
            • Resolved
            1.
            		 Add client failover functionality to o.a.h.io.(ipc|retry) Sub-task Closed Aaron T. Myers
             
            2.
            		 Introduce HA Service Protocol Interface Sub-task Resolved Suresh Srinivas
             
            3.
            		 HA: Administrative CLI to control HA daemons Sub-task Resolved Todd Lipcon
             
            4.
            		 HA: if both NNs are in Standby mode, client needs to try failing back and forth several times with sleeps Sub-task Resolved Aaron T. Myers
             
            5.
            		 StandbyException should extend IOException Sub-task Resolved Todd Lipcon
             
            6.
            		 HA: Improve some logging for client IPC failovers and StandbyExceptions Sub-task Resolved Todd Lipcon
             
            7.
            		 
FailoverController for client-based configuration Sub-task Resolved Eli Collins
             
            8.
            		 Add interface and update CLI to query current state to HAServiceProtocol Sub-task Resolved Eli Collins
             
            9.
            		 HA: Client failover policy is incorrectly trying to fail over all IOExceptions Sub-task Resolved Aaron T. Myers
             
            10.
            		 HA : Make client connection retries on socket time outs configurable. Sub-task Resolved Uma Maheswara Rao G
             
            11.
            		 HA: the FailoverController should optionally fence the active during failover Sub-task Resolved Eli Collins
             
            12.
            		 HA: failover should error out if either host is not specified in the configs Sub-task Resolved Eli Collins
             
            13.
            		 HA: fencing mechanism Sub-task Resolved Todd Lipcon
             
            14.
            		 All HAServiceProtocol methods have to throw IOException since they are invoked over the network Sub-task Resolved Hari Mankude
             
            15.
            		 HA: failover should be able to pass args to fencers Sub-task Resolved Eli Collins
             
            16.
            		 HA: the FailoverController should check the standby is ready before failing over Sub-task Resolved Eli Collins
             
            17.
            		 HA: Add 'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml file. Sub-task Resolved Uma Maheswara Rao G
             
            18.
            		 HA: log a warning when a failover is first attempted Sub-task Resolved Todd Lipcon
             
            19.
            		 HA: void methods can swallow exceptions when going through failover path Sub-task Resolved Todd Lipcon
             
            20.
            		 HA: RetriableCommand is using RetryPolicy incorrectly after HADOOP-7896 Sub-task Resolved Aaron T. Myers
             
            21.
            		 HA: HAServiceProtocol exceptions need to be unwrapped before it can be used Sub-task Resolved Hari Mankude
             
            22.
            		 Add ZK client for leader election Sub-task Resolved Bikas Saha
             

              Activity

              No work has yet been logged on this issue.

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  Aaron T. Myers
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  9 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development