[MAPREDUCE-1841] o.a.h.mapreduce.FileOutputCommitter doens't check for existence of ${mapred.output.dir}/_temporary

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.2
• Component/s: task
• Assignee: Arun Murthy
• Reporter: Arun Murthy
• Created: 03/Jun/10 18:44
• Updated: 30/Jul/14 19:57
• Resolved: 30/Jul/14 19:57

Description

o.a.h.mapred.FileOutputCommitter.getWorkOutputPath checks for existence of ${mapred.output.dir}/temporary to ensure tasks launched _after the job-cleanup task fail early (in a vast majority of cases). This check is missing in the mapreduce libraries.

Related note: FileOutputCommitter.setupTask seems a more appropriate place for the above check...