[MAPREDUCE-3993] Graceful handling of codec errors during decompression

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.1, 1.0.2
• Fix Version/s: 1.2.0, 2.0.2-alpha
• Component/s: mrv1, mrv2
• Target Version/s: 1.2.0
• Hadoop Flags: Reviewed
• Assignee: Karthik Kambatla
• Reporter: Todd Lipcon
• Created: 09/Mar/12 08:44
• Updated: 03/Nov/14 18:05
• Resolved: 09/Jul/12 19:22

Description

When using a compression codec for intermediate compression, some cases of corrupt data can cause the codec to throw exceptions other than IOException (eg java.lang.InternalError). This will currently cause the whole reduce task to fail, instead of simply treating it like another case of a failed fetch.