[SPARK-3293] yarn's web show "SUCCEEDED" when the driver throw a exception in yarn-client

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.2, 1.1.0
• Fix Version/s: 1.2.0
• Component/s: YARN
• Assignee: Guoqiang Li
• Reporter: Fei Wang
• Created: 29/Aug/14 03:36
• Updated: 28/Nov/14 12:11
• Resolved: 26/Sep/14 21:26

Description

If an exception occurs, the yarn'web->Applications->FinalStatus will also be the "SUCCEEDED" without the expectation of "FAILED".
In the release of spark-1.0.2, only yarn-client mode will show this.
But recently the yarn-cluster mode will also be a problem.

To reply this:
just new a sparkContext and then throw an exception
then watch the yarn websit about applications

Issue Links

• duplicates: SPARK-3627 spark on yarn reports success even though job fails
• links to: [Github] Pull Request #2311 (witgo)
• links to: [Github] Pull Request #3508 (SaintBacchus)