[SPARK-13522] Executor should kill itself when it's unable to heartbeat to the driver more than N times

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.2, 2.0.0
• Component/s: Spark Core
• Target Version/s: 2.0.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 26/Feb/16 20:54
• Updated: 12/May/16 00:32
• Resolved: 29/Feb/16 19:03

Description

Sometimes, network disconnection event won't be triggered for other potential race conditions that we may not have thought of, then the executor will keep sending heartbeats to driver and won't exit.

We should make Executor kill itself when it's unable to heartbeat to the driver more than N times

Issue Links

• links to: [Github] Pull Request #11401 (zsxwing)
• links to: [Github] Pull Request #11432 (zsxwing)