[AVRO-852] TetheredProcess - incompatibility between Hadoop-0.20.2 and Cloudera Release 3

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.5.1
• Component/s: java
• Labels: hadoop
• Tags: hadoop, cloudera, tether
• Assignee: Jeremy Lewi
• Reporter: Jeremy Lewi
• Created: 06/Jul/11 19:40
• Updated: 17/Oct/11 22:41

Description

There seems to be an incompatibility between hadoop-0.20.2 and cloudera release 3.0.
In particular the call signature for TaskLog.getTaskLogFile differs between the two.
In CDH3 the signature is

getTaskLogFile(TaskAttemptID taskid, boolean isCleanup, TaskLog.LogName filter) 

but in Hadoop-0.20.2 it is

getTaskLogFile(TaskAttemptID taskid, boolean isCleanup)   

avro.mapred.tether.TetheredProcess invokes getTaskLogFile

Hadoop 0.20.203.0 is consistent with CDH3.

Can we use the newer syntax

getTaskLogFile(TaskAttemptID taskid, boolean isCleanup, TaskLog.LogName filter) 

and change the hadoop version in the top level pom to

<hadoop-version>0.20.203.0</hadoop-version>

Issue Links

• blocks: AVRO-935 Update Java dependencies for 1.6.0
• is related to: AVRO-570 python implementation of mapreduce connector