[FLINK-8466] ErrorInfo needs to hold Exception as SerializedThrowable

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: Runtime / Task
• Assignee: Stephan Ewen
• Reporter: Jelmer Kuperus
• Created: 20/Jan/18 13:23
• Updated: 24/Jan/18 21:33
• Resolved: 24/Jan/18 21:33

Description

MemoryArchivist holding on to last thrown exception prevents the user code classloader from being garbage collected.

MemoryArchivist holds on to any number of ArchivedExecutionGraph's. These ArchivedExecutionGraph instances contain a failureCause field of type ErrorInfo that wrap the exception in case one was thrown to terminate the job

This exception class will more often than not have been loaded by a user code classloader, and as long as the MemoryArchivist holds on to this exception, the JVM won't be able to reclaim the resources held by this classloader

Issue Links

• links to: GitHub Pull Request #5348