[KAFKA-934] kafka hadoop consumer and producer use older 0.19.2 hadoop api's

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.8.0
• Component/s: contrib
• Labels: hadoop hadoop-2.0 newbie
• Environment: [amilkowski@localhost impl]$ uname -a; Linux localhost.localdomain 3.9.4-200.fc18.x86_64 #1 SMP Fri May 24 20:10:49 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
• Assignee: Grant Henke
• Reporter: Andrew Milkowski
• Created: 05/Jun/13 16:58
• Updated: 26/Jan/16 04:24
• Resolved: 26/Jan/16 04:24

Description

New hadoop api present in 0.20.1 especially package org.apache.hadoop.mapredude.lib is not used

code affected is both consumer and producer in kafka in the contrib package

[amilkowski@localhost contrib]$ pwd
/opt/local/git/kafka/contrib
[amilkowski@localhost contrib]$ ls -lt
total 12
drwxrwxr-x 8 amilkowski amilkowski 4096 May 30 11:14 hadoop-consumer
drwxrwxr-x 6 amilkowski amilkowski 4096 May 29 19:31 hadoop-producer
drwxrwxr-x 6 amilkowski amilkowski 4096 May 29 16:43 target
[amilkowski@localhost contrib]$

in example

import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
import org.apache.hadoop.mapred.RunningJob;
import org.apache.hadoop.mapred.TextOutputFormat;

use 0.19.2 hadoop api format, this prevents merging of hadoop feature into more modern hadoop implementation

instead of drawing from 0.20.1 api set in import org.apache.hadoop.mapreduce