Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12730

Hadoop streaming -mapper and -reducer options are wrongly documented as required

    Details

    • Hadoop Flags:
      Reviewed

      Description

      -reducer is listed as a Required option, but is a -reducer still required if the Streaming job is Map only?

      http://hadoop.apache.org/docs/r1.2.1/streaming.html#Specifying+Map-Only+Jobs

      -reducer should not be listed as a Required option.

        Activity

        Hide
        sekikn Kengo Seki added a comment -

        I think -mapper is also optional. I'd like to fix the document.

        Show
        sekikn Kengo Seki added a comment - I think -mapper is also optional. I'd like to fix the document.
        Hide
        sekikn Kengo Seki added a comment -

        Attached a patch.

        Show
        sekikn Kengo Seki added a comment - Attached a patch.
        Hide
        hadoopqa Hadoop QA added a comment -



        +1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 2m 54s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 release audit 0m 20s The applied patch does not increase the total number of release audit warnings.
        +1 site 2m 57s Site still builds.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
            6m 14s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12732588/MAPREDUCE-6200.001.patch
        Optional Tests site
        git revision trunk / 065d8f2
        Java 1.7.0_55
        uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5729/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 pre-patch 2m 54s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 release audit 0m 20s The applied patch does not increase the total number of release audit warnings. +1 site 2m 57s Site still builds. +1 whitespace 0m 0s The patch has no lines that end in whitespace.     6m 14s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12732588/MAPREDUCE-6200.001.patch Optional Tests site git revision trunk / 065d8f2 Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5729/console This message was automatically generated.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1, committing this.

        Show
        ajisakaa Akira Ajisaka added a comment - +1, committing this.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvnsite 1m 10s trunk passed
        +1 mvnsite 0m 20s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 27s Patch does not generate ASF License warnings.
        2m 19s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:0ca8df7
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12732588/MAPREDUCE-6200.001.patch
        JIRA Issue HADOOP-12730
        Optional Tests asflicense mvnsite
        uname Linux f2610bd53349 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 6831634
        modules C: hadoop-tools/hadoop-streaming U: hadoop-tools/hadoop-streaming
        Max memory used 29MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8449/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvnsite 1m 10s trunk passed +1 mvnsite 0m 20s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 27s Patch does not generate ASF License warnings. 2m 19s Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12732588/MAPREDUCE-6200.001.patch JIRA Issue HADOOP-12730 Optional Tests asflicense mvnsite uname Linux f2610bd53349 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 6831634 modules C: hadoop-tools/hadoop-streaming U: hadoop-tools/hadoop-streaming Max memory used 29MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8449/console This message was automatically generated.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Committed this to trunk, branch-2, and branch-2.8. Thanks Kengo Seki for the contribution!

        Show
        ajisakaa Akira Ajisaka added a comment - Committed this to trunk, branch-2, and branch-2.8. Thanks Kengo Seki for the contribution!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #9165 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9165/)
        HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly (aajisaka: rev 0bae506c221f9736d08a6fba00ce5a862ab43cce)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-tools/hadoop-streaming/src/site/markdown/HadoopStreaming.md.vm
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9165 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9165/ ) HADOOP-12730 . Hadoop streaming -mapper and -reducer options are wrongly (aajisaka: rev 0bae506c221f9736d08a6fba00ce5a862ab43cce) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-streaming/src/site/markdown/HadoopStreaming.md.vm

          People

          • Assignee:
            sekikn Kengo Seki
            Reporter:
            dvohra DeepakVohra
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development