[MAPREDUCE-4423] Potential infinite fetching of map output

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 0.23.3, 2.0.2-alpha
• Component/s: mrv2
• Target Version/s: 0.23.3
• Assignee: Robert Joseph Evans
• Reporter: Robert Joseph Evans
• Created: 10/Jul/12 15:26
• Updated: 12/May/16 18:24
• Resolved: 27/Jul/12 01:51

Description

Inside Fetcher.java there are a few cases where an error can happen and the corresponding map task is not marked as a fetch failure. One of these is if the Shuffle server returns a malformed result.

MAPREDUCE-3992 makes this case a lot less common, but it is still possible. IF the shuffle handler always returns a malformed result, but a OK response the Fetcher will never stop trying to fetch those results.