[MAPREDUCE-1785] Add streaming config option for not emitting the key

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 0.22.0
• Component/s: contrib/streaming
• Hadoop Flags: Reviewed

Release Note

Added a configuration property "stream.map.input.ignoreKey" to specify whether to ignore key or not while writing input for the mapper. This configuration parameter is valid only if stream.map.input.writer.class is org.apache.hadoop.streaming.io.TextInputWriter.class. For all other InputWriter's, key is always written.

• Assignee: Eli Collins
• Reporter: Eli Collins
• Created: 12/May/10 19:27
• Updated: 11/Jun/10 10:07
• Resolved: 02/Jun/10 07:46

Description

PipeMapper currently does not emit the key when using TextInputFormat. If you switch to input formats (eg LzoTextInputFormat) the key will be emitted. We should add an option so users can explicitly make streaming not emit the key so they can change input formats without breaking or having to modify their existing programs.