Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-609

Streaming: better support for command lines or streaming command

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: contrib/streaming
    • Labels:
      None

      Description

      Quite often, the command line for streaming mapper or reducer needs to use one or two levels of quotes.
      This make it inconvenient or impossible to pass the commands in the streaming command line.
      It would be good to have streaming take its specification from a file – especially as longer streaming commands are not typed in, but are either run from files (shell scripts) or generated by other processors.

      The current work around is to separate files for the mapper command, for the reducer command, and for the streaming command itself. This works, but is inconvenient and quite error-prone.
      Having just one file with all three would be good.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              arkady arkady borkovsky
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated: