[SPARK-29344] Spark application hang

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 2.4.1
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Kitti
• Created: 03/Oct/19 10:22
• Updated: 12/Dec/22 18:10
• Resolved: 04/Oct/19 08:21

Description

We found the issue that Spark application hang and stop working sometime without any log in Spark Driver until we killed the application. 

 

19/10/03 06:07:03 INFO spark.ContextCleaner: Cleaned accumulator 117 19/10/03 06:07:03 INFO spark.ContextCleaner: Cleaned accumulator 80 19/10/03 06:07:03 INFO spark.ContextCleaner: Cleaned accumulator 105 19/10/03 06:07:03 INFO spark.ContextCleaner: Cleaned accumulator 88 19/10/03 10:36:59 ERROR yarn.ApplicationMaster: RECEIVED SIGNAL TERM