[HADOOP-11824] HDFS client and YARN should check for elected master with Zookeeper

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Nate Edel
• Reporter: Nate Edel
• Created: 10/Apr/15 19:00
• Updated: 10/Apr/15 19:47

Description

When trying to connect to a NameNode (DFS) or Resource Manager (Yarn), clients will try multiple connections in order to find the elected master node. Clients should instead check the relevant znode in zookeeper.

This will be especially valuable in DFS after HDFS-6440 is adopted, as the worst case scenario in the DFS client will then be testing more than one standby nodes in order before finding the master.

Issue Links

• relates to: HDFS-7858 Improve HA Namenode Failover detection on the client