[MAPREDUCE-3519] Deadlock in LocalDirsHandlerService and ShuffleHandler

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.1, 2.0.0-alpha
• Fix Version/s: 0.23.1
• Component/s: mrv2, nodemanager
• Target Version/s: 0.23.1
• Hadoop Flags: Reviewed
• Release Note: Fixed a deadlock in NodeManager LocalDirectories's handling service.
• Assignee: Ravi Gummadi
• Reporter: Ravi Gummadi
• Created: 08/Dec/11 05:02
• Updated: 10/Mar/15 04:32
• Resolved: 09/Dec/11 23:21

Description

MAPREDUCE-3121 cloned Configuration object in LocalDirsHandlerService.init() to avoid others to access that configuration object. But since it is used in local FileSystem object creation in LocalDirAllocator.AllocatorPerContext and the same FileSystem object is used in ShuffleHandler.Shuffle.localDirAllocator, this is causing a deadlock when accessing this configuration object from LocalDirsHandlerService and ShuffleHandler along with AllocatorPerContext object.