[SPARK-704] ConnectionManager sometimes cannot detect loss of sending connections

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Charles Reiss
• Created: 22/Feb/13 14:47
• Updated: 14/Mar/15 19:49
• Resolved: 14/Mar/15 19:49

Description

ConnectionManager currently does not detect when SendingConnections disconnect except if it is trying to send through them. As a result, a node failure just after a connection is initiated but before any acknowledgement messages can be sent may result in a hang.

ConnectionManager has code intended to detect this case by detecting the failure of a corresponding ReceivingConnection, but this code assumes that the remote host:port of the ReceivingConnection is the same as the ConnectionManagerId, which is almost never true. Additionally, there does not appear to be any reason to assume a corresponding ReceivingConnection will exist.