[MAPREDUCE-3130] Output files are not moved to job output directory after task completion

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.20.204.0
• Component/s: task

Environment

NA

• Assignee: Unassigned
• Reporter: Bhallamudi Venkata Siva Kamesh
• Created: 30/Sep/11 13:57
• Updated: 28/May/12 05:40

Description

When MultipleOutputs (OutputFormat set to TextOutputFormat) is used to write output files to different namedOutputFiles, turned off normal output file generation(i.e.part-r-<#reduce>) by setting OutputFormat as NullOutputFormat, task output is not moved to job output directory (${mapred.output.dir}).

After the job completion, found output files in ${mapred.output.dir}/_temporary/_attempt-<jobid>-<#reduce> (task output directory) rather than in the ${mapred.output.dir} (job output dir)

Issue Links

• is related to: MAPREDUCE-2493 New Api FileOutputFormat does not honour user specified OutputCommitter