[HADOOP-8325] Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 0.23.3, 2.0.2-alpha
• Component/s: fs
• Hadoop Flags: Reviewed
• Assignee: Alejandro Abdelnur
• Reporter: Alejandro Abdelnur
• Created: 27/Apr/12 18:14
• Updated: 21/Mar/16 20:01
• Resolved: 30/Apr/12 19:22

Description

FileSystem adds a JVM shutdown hook when a filesystem instance is cached.

MRAppMaster also uses a JVM shutdown hook, among other things, the MRAppMaster JVM shutdown hook is used to ensure state are written to HDFS.

This creates a race condition because each JVM shutdown hook is a separate thread and if there are multiple JVM shutdown hooks there is not assurance of order of execution, they could even run in parallel.

Issue Links

• is depended upon by: MAPREDUCE-4135 MRAppMaster throws IllegalStateException while shutting down
• is depended upon by: MAPREDUCE-4205 retrofit all JVM shutdown hooks to use ShutdownHookManager
• relates to: HADOOP-12950 ShutdownHookManager should have a timeout for each of the Registered shutdown hook