[MAPREDUCE-1888] Streaming overrides user given output key and value types.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Fix Version/s: 0.22.0
• Component/s: contrib/streaming
• Assignee: Ravi Gummadi
• Reporter: Amareshwari Sriramadasu
• Created: 23/Jun/10 04:31
• Updated: 12/Dec/11 06:19
• Resolved: 05/Jul/10 05:12

Description

The following code in StreamJob.java overrides user given output key and value types.

    idResolver.resolve(conf.get(StreamJobConfig.MAP_OUTPUT,
        IdentifierResolver.TEXT_ID));
    conf.setClass(StreamJobConfig.MAP_OUTPUT_READER_CLASS,
      idResolver.getOutputReaderClass(), OutputReader.class);
    job.setMapOutputKeyClass(idResolver.getOutputKeyClass());
    job.setMapOutputValueClass(idResolver.getOutputValueClass());
    
    idResolver.resolve(conf.get(StreamJobConfig.REDUCE_OUTPUT,
        IdentifierResolver.TEXT_ID));
    conf.setClass(StreamJobConfig.REDUCE_OUTPUT_READER_CLASS,
      idResolver.getOutputReaderClass(), OutputReader.class);
    job.setOutputKeyClass(idResolver.getOutputKeyClass());
    job.setOutputValueClass(idResolver.getOutputValueClass());

Issue Links

• duplicates: MAPREDUCE-1138 Erroneous output folder handling in streaming testcases