[SPARK-24700] AM shutdown terminates streaming application but marks it as successful

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: 2.2.0
• Component/s: Spark Core, Structured Streaming, YARN
• Assignee: Unassigned
• Reporter: Niranjani
• Created: 29/Jun/18 23:21
• Updated: 12/Feb/19 21:13
• Resolved: 12/Feb/19 21:13

Description

While running Spark streaming applications on YARN in cluster mode, reboot/shutdown of the node hosting AM causes the application to terminate SparkContext and mark it as SUCCEEDED. This is misleading as:

1. streaming applications are long-running and not expected to terminate
2. setting spark.yarn.maxAppAttempts for application re-attempt does not take effect since this scenario is not recognized as a failure

Please provide a workaround for resubmitting streaming/long-running applications in the case of AM shutdown.