[MAPREDUCE-2079] PipesMapRunner does not use map output classes

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.20.1, 0.20.2, 0.20.3, 0.21.0, 0.21.1, 0.22.0
• Component/s: pipes

Environment

Ubuntu 10.04 Lucid 64bit, Java(TM) SE Runtime Environment (build 1.6.0_20-b02), Hadoop 20.2 (Cloudera distribution)

• Tags: hadoop mapreduce pipes map output class
• Assignee: Unassigned
• Reporter: Cosmin Catanoaie
• Created: 19/Sep/10 18:41
• Updated: 10/Jan/11 20:53

Description

In org.apache.hadoop.mapred.pipes.PipesMapRunner.java at lines 71-72 instead of:

• job.getOutputKeyClass() and
• job.getOutputValueClass()

there should be called:

• job.getMapOutputKeyClass() and
• job.getMapOutputValueClass()

This modification will allow pipe jobs to use intermediate map output classes different from the job final output classes.