[MAPREDUCE-6136] MRAppMaster doesn't shutdown file systems

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.1, 2.6.0
• Fix Version/s: 2.7.0
• Component/s: applicationmaster
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Brahma Reddy Battula
• Reporter: Noah Watkins
• Created: 23/Oct/14 01:10
• Updated: 10/Apr/15 20:19
• Resolved: 05/Mar/15 05:23

Description

When MRAppMaster exit it doesn't call close on its open file systems instances.

MAPREDUCE-3614 sets conf.setBoolean("fs.automatic.close", false); in MRAppMaster::main and then called FileSystem.closeAll() in MRAppMasterShutdownHook.

However, MAPREDUCE-4205 removed the call to FileSystem.closeAll() MRAppMasterShutdownHook but left `fs.automatic.close` set to false.

Removing `conf.setBoolean("fs.automatic.close", false);` worked for me, but it wasn't clear if this had other implications.