[SPARK-24363] spark context exit abnormally

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.1.2
• Component/s: Java API, Spark Core, Spark Submit, YARN

Environment

spark2.1.2   
hadoop2.6.0-cdh5.4.7
 
 

• Assignee: Unassigned
• Reporter: nilone
• Created: 23/May/18 09:22
• Updated: 12/Dec/22 18:10
• Resolved: 24/May/18 02:43

Description

I create a sparkcontext instance with yarn-client mode in my program (a web application) for users to submit their jobs ,It can work for a for a period of time, but then it suddenly comes out without any new job running.It looks like the context has been killed, and I'm not sure whether the problem is on the yarn or on the spark.

You can see my screenshot and log file.