[ZOOKEEPER-1678] Server fails to join quorum when a peer is unreachable (5 ZK server setup)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.5
• Component/s: leaderElection

Environment

java version "1.6.0_32"
Java(TM) SE Runtime Environment (build 1.6.0_32-b05)
Java HotSpot(TM) 64-Bit Server VM (build 20.7-b02, mixed mode)

Distributor ID: Ubuntu
Description: Ubuntu 12.04.1 LTS
Release: 12.04
Codename: precise

uname -a Linux ha-vani3-0 3.2.0-23-virtual #36-Ubuntu SMP Tue Apr 10 22:29:03 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux

• Assignee: Unassigned
• Reporter: Julio Lopez
• Created: 29/Mar/13 00:19
• Updated: 09/Jul/13 09:43

Description

In a 5-node ZK cluster setup, in the following state:

• 1 host is down / not reachable.
• 4 hosts are up.
• 3 ZK servers are in quorum.
• a 4th ZK server was restarted and is trying to re-join the quorum.

The 4th server is not able to rejoin the quorum because the connection to the host that is not established, and apparently takes to long to timeout.

Stack traces and additional information coming.

Issue Links

• relates to: ZOOKEEPER-900 FLE implementation should be improved to use non-blocking sockets