[BEAM-9006] Meta space memory leak caused by the shutdown hook of ProcessManager

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.19.0
• Component/s: java-fn-execution
• Assignee: sunjincheng
• Reporter: sunjincheng
• Created: 20/Dec/19 03:19
• Updated: 16/May/20 14:12
• Resolved: 02/Jan/20 11:12

Description

Currently the class `ProcessManager` will add a shutdown hook to stop all the living processes before JVM exits. The shutdown hook will never be removed. If this class is loaded by the user class loader, it will cause the user class loader could not be garbage collected which causes meta space memory leak eventually.

Issue Links

• is related to: FLINK-15338 TM Metaspace memory leak when submitting PyFlink UDF jobs multiple times
• is related to: BEAM-9030 Bump grpc to 1.26.0
• links to: GitHub Pull Request #10462