[SPARK-6924] driver hangs when net is broken

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: xukun
• Created: 15/Apr/15 06:14
• Updated: 10/May/15 20:17
• Resolved: 10/May/15 20:17

Description

In yarn-client mode, client is deployed out side of cluster. When the net between client and cluster is broken, driver lost all executors. In normal situation, client returns and app fails. Actually, the driver hangs, user do not know whether app is ok. So we should let driver return not hang.
The solution: in HeartbeatReceiver thread, check whether some executor send heartbeat to dirver at the fixed rate. If no execuor send heartbeats to driver, close SparkContext.

Issue Links

• is duplicated by: SPARK-7094 driver process will be suspend when driver network has down
• links to: [Github] Pull Request #5523 (viper-kun)
• links to: [Github] Pull Request #5663 (SaintBacchus)