[HDFS-4101] ZKFC should implement zookeeper.recovery.retry like HBase to connect to ZooKeeper

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
• Component/s: auto-failover, ha
• Labels: BB2015-05-TBR newbie

Environment

running CDH4.1.1

• Release Note: Make ZK connection retries also available at startup.
• Assignee: Damien Hardy
• Reporter: Damien Hardy
• Created: 22/Oct/12 11:06
• Updated: 02/Nov/16 22:54

Description

When zkfc start and zookeeper is not yet started ZKFC fails and stop directly.

Maybe ZKFC should allow some retries on Zookeeper services like does HBase with zookeeper.recovery.retry

This particularly appends when I start my whole cluster on VirtualBox for example (every components nearly at the same time) ZKFC is the only that fail and stop ...
Every others can wait each-others some time independently of the start order like NameNode/DataNode/JournalNode/Zookeeper/HBaseMaster/HBaseRS so that the system can be set and stable in few seconds

Issue Links

• relates to: HADOOP-13781 ZKFailoverController#initZK should use the ActiveStanbyElector constructor with failFast as false