[FLINK-16416] Shutdown the task manager gracefully in standalone mode

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: Command Line Client
• Assignee: Unassigned
• Reporter: Yangze Guo
• Created: 04/Mar/20 07:58
• Updated: 30/Nov/21 20:37
• Resolved: 05/Mar/20 01:35

Description

Recently, I try to add a new GPUManager to the TaskExecutorServices. I register the "GPUManager#close" function, in which I write some cleanup logic, to the TaskExecutorServices#shutDown. However, I found that the cleanup logic does not run as expected in standalone mode.
After an investigation in the codebase, I found that the TaskExecutorServices#shutDown will be called only on a fatal error while we just kill the TM process in the flink-daemon.sh. However, the LOG shows that some services, e.g. TaskExecutorLocalStateStoresManager, did clean up themselves by registering shutdownHook.
If that is the right way, then we need to register a shutdownHook for TaskExecutorServices as well.
If that is not, we may find another solution to shutdown TM gracefully.