[MAPREDUCE-6639] Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.2
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: mrv2
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 19/Feb/16 17:29
• Updated: 30/Aug/16 01:14
• Resolved: 12/May/16 18:02

Description

ListLocatedFileStatusFetcher uses a thread pool, but one of the Callable thread functions, ProcessInitialInputPathCallable, doesn't catch exceptions (the callbacks do). When an exception is thrown, the thread exists and doesn't signal the error to the calling thread, which continues waiting to be signaled. This can happen when a FS implementation cannot be found.