[SPARK-14400] ScriptTransformation does not fail the job for bad user command

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.1
• Fix Version/s: 2.0.0
• Component/s: SQL
• Target Version/s: 2.0.0
• Assignee: Tejas Patil
• Reporter: Tejas Patil
• Created: 05/Apr/16 06:52
• Updated: 27/May/16 19:05
• Resolved: 27/May/16 19:05

Description

If the `script` to be ran is an incorrect command, Spark does not catch the failure in running the sub-process and the job is marked as successful.

Issue Links

• links to: [Github] Pull Request #12194 (tejasapatil)