[MAPREDUCE-4135] MRAppMaster throws IllegalStateException while shutting down

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 0.23.3
• Component/s: mrv2
• Assignee: Ravi Prakash
• Reporter: Devaraj Kavali
• Created: 11/Apr/12 06:04
• Updated: 12/May/16 18:24
• Resolved: 10/Jul/12 21:27

Description

Always MRAppMaster throws IllegalStateException in the stderr while shutting down. It doesn't look good having this exception in the stderr file of MRAppMaster container.

WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Exception in thread "Thread-1" java.lang.IllegalStateException: Shutdown in progress
	at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:55)
	at java.lang.Runtime.removeShutdownHook(Runtime.java:220)
	at org.apache.hadoop.fs.FileSystem$Cache.remove(FileSystem.java:2148)
	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2180)
	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2157)
	at org.apache.hadoop.fs.FileSystem.closeAll(FileSystem.java:361)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1014)

Issue Links

• depends upon: HADOOP-8325 Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook
• duplicates: MAPREDUCE-4137 MRAppMaster shutdown hook should not call FileSystem.closeAll()
• is blocked by: MAPREDUCE-4157 ResourceManager should not kill apps that are well behaved