[MAPREDUCE-3697] Hadoop Counters API limits Oozie's working across different hadoop versions

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.1
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Assignee: Mahadev Konar
• Reporter: John George
• Created: 19/Jan/12 15:04
• Updated: 02/May/13 02:29
• Resolved: 07/Feb/12 01:43

Description

Oozie uses Hadoop Counters API, by invoking Counters.getGroup(). However, in
hadoop 23, org.apache.hadoop.mapred.Counters does not implement getGroup(). Its
parent class AbstractCounters implements it. This is different from hadoop20X.
As a result, Oozie compiled with either hadoop version does not work with the
other version.
A specific scenario, Oozie compiled with .23 and run against 205, does not
update job status owing to a Counters API exception.

Will explicit re-compilation against the relevant hadoop jars be required each
time? This will prevent launching a uniform Oozie version across different
clusters.

Issue Links

• is depended upon by: HIVE-2741 Single binary built against 0.20 and 0.23, does not work against 0.23 clusters.
• is related to: HADOOP-7738 Document incompatible API changes between 0.20.20x and 0.23.0 release
• relates to: MAPREDUCE-5055 Binary compatibility for the method Reporter.incrCounter(String group, String counter, long amount) between hadoop-1.x and hadoop-2.x