[ZOOKEEPER-1702] ZooKeeper client may write operation packets before receiving successful response to connection request, can cause TCP RST

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.2
• Fix Version/s: 3.4.6, 3.5.0
• Component/s: java client
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 09/May/13 20:24
• Updated: 13/Mar/14 18:17
• Resolved: 01/Jul/13 23:24

Description

The problem occurs when a connection attempt is pending and there are multiple outbound packets in the queue for other operations. In ClientCnxnSocketNIO#doIO, it is possible to receive notification that the socket is writable for the next operation packet before receiving notification that the socket is readable for the connection response from the server. If the server decides that the session is expired, then it responds by immediately closing the socket on its side. If the client has written packets after the server has closed its end of the socket, then the TCP stack may choose to abort the connection with an RST. When this happens, the client doesn't receive an orderly shutdown, and ultimately it fails to deliver a session expired event to the application.

Issue Links

• is related to: HADOOP-9556 disable HA tests on Windows that fail due to ZooKeeper client connection management bug
• is required by: HADOOP-9555 HA functionality that uses ZooKeeper may experience inadvertent TCP RST and miss session expiration event due to bug in client connection management