Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1772

Hadoop streaming doc should not use IdentityMapper as an example

    Details

    • Hadoop Flags:
      Reviewed

      Description

      From the URL http://hadoop.apache.org/core/docs/current/streaming.html

      This example doesn't work:

      You can supply a Java class as the mapper and/or the reducer. The above example is equivalent to:

      $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar \
      -input myInputDirs \
      -output myOutputDir \
      -mapper org.apache.hadoop.mapred.lib.IdentityMapper \
      -reducer /bin/wc

      This will produce the following exception:

      java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org.apache.hadoop.io.LongWritable

        Attachments

        1. patch-1772-2.txt
          18 kB
          Amareshwari Sriramadasu
        2. patch-1772-1.txt
          17 kB
          Amareshwari Sriramadasu
        3. patch-1772.txt
          15 kB
          Amareshwari Sriramadasu

          Activity

            People

            • Assignee:
              amareshwari Amareshwari Sriramadasu
              Reporter:
              menicosia Marco Nicosia
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: