Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-862

In Map-only Streaming (reducer=NONE), oozie runs reducer along with mapper(s).

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Invalid
    • None
    • None
    • None
    • None

    Description

      Oozie runs map-only streaming job with reducer, which is not intended.

      It always creates reducer when I give any of the following in workflow.xml
      --------------------------------------------
      <streaming>
      <mapper>mule_perm.pl</mapper>
      <reducer>NONE</reducer>
      </streaming>
      --------------------------------------------
      Or
      --------------------------------------------
      <streaming>
      <mapper>mule_perm.pl</mapper>
      </streaming>
      --------------------------------------------

      No reducer is created only when, I give following in workflow.xml as
      configuration. (which is not intuitive/matching with hadoop jar streaming
      command).
      ------------------------------------------
      <configuration>
      <property>
      <name>mapred.reduce.tasks</name>
      <value>0</value>
      </property>
      ...
      ------------------------------------------

      Attachments

        1. OOZIE-862.patch
          4 kB
          Britt Cyr
        2. OOZIE-862-v2.patch
          5 kB
          Britt Cyr

        Activity

          People

            bcyr Britt Cyr
            bcyr Britt Cyr
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: