Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1888

Streaming overrides user given output key and value types.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.22.0
    • Component/s: contrib/streaming
    • Labels:
      None

      Description

      The following code in StreamJob.java overrides user given output key and value types.

          idResolver.resolve(conf.get(StreamJobConfig.MAP_OUTPUT,
              IdentifierResolver.TEXT_ID));
          conf.setClass(StreamJobConfig.MAP_OUTPUT_READER_CLASS,
            idResolver.getOutputReaderClass(), OutputReader.class);
          job.setMapOutputKeyClass(idResolver.getOutputKeyClass());
          job.setMapOutputValueClass(idResolver.getOutputValueClass());
          
          idResolver.resolve(conf.get(StreamJobConfig.REDUCE_OUTPUT,
              IdentifierResolver.TEXT_ID));
          conf.setClass(StreamJobConfig.REDUCE_OUTPUT_READER_CLASS,
            idResolver.getOutputReaderClass(), OutputReader.class);
          job.setOutputKeyClass(idResolver.getOutputKeyClass());
          job.setOutputValueClass(idResolver.getOutputValueClass());
      

        Attachments

        1. 1888.patch
          9 kB
          Ravi Gummadi
        2. 1888.v1.patch
          25 kB
          Ravi Gummadi
        3. 1888.v2.patch
          26 kB
          Ravi Gummadi
        4. 1888.v3.patch
          29 kB
          Ravi Gummadi
        5. 1888.v4.patch
          34 kB
          Ravi Gummadi

          Issue Links

            Activity

              People

              • Assignee:
                ravidotg Ravi Gummadi
                Reporter:
                amareshwari Amareshwari Sriramadasu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: