Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3521

Hadoop Streaming ignores unknown parameters

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2
    • None

    Description

      The hadoop streaming command will ignore any command line arguments to it.

      hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
      

      Works just fine. This can mask issues where quotes were mistakenly missed like

      hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
      

      Streaming should fail if it encounters an unexpected command line parameter

      Attachments

        1. MR-3521.txt
          2 kB
          Robert Joseph Evans

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            revans2 Robert Joseph Evans
            revans2 Robert Joseph Evans
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment