[MAPREDUCE-609] Streaming: better support for command lines or streaming command

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: contrib/streaming
• Assignee: Unassigned
• Reporter: arkady borkovsky
• Created: 30/Nov/07 22:19
• Updated: 12/Jul/10 11:29

Description

Quite often, the command line for streaming mapper or reducer needs to use one or two levels of quotes.
This make it inconvenient or impossible to pass the commands in the streaming command line.
It would be good to have streaming take its specification from a file – especially as longer streaming commands are not typed in, but are either run from files (shell scripts) or generated by other processors.

The current work around is to separate files for the mapper command, for the reducer command, and for the streaming command itself. This works, but is inconvenient and quite error-prone.
Having just one file with all three would be good.