[MAPREDUCE-4847] Command Parsing in Hadoop Streaming

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: contrib/streaming
• Labels: features
• Assignee: Unassigned
• Reporter: Peng Lei
• Created: 05/Dec/12 02:40
• Updated: 11/Dec/12 08:54

Description

Hadoop streaming parse the mapper and reducer commands by itself, this is not a good choice, when I write a complex mapper/reducer script inline, such as 'perl -ne ...', it don't work.
An alternative way is to send the command to the shell, simply create new process(sh -c "command_and_args"), this not also simplize the streaming code, but also improve its capability!