[OOZIE-1728] When an ApplicationMaster restarts, it restarts the launcher job: DistCp followup

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: 4.2.0
• Assignee: Ryota Egashira
• Reporter: Robert Kanter
• Created: 04/Mar/14 23:27
• Updated: 18/May/15 07:11
• Resolved: 15/Oct/14 22:39

Description

In doing OOZIE-1722, we had not not add support for the DistCp action because there wasn't a good clean way to set the mapreduce.job.tags property on the job launched by DistCp that would work between all versions of Hadoop.

The best solution would be to switch our version of Hadoop 1 to Hadoop 1.2.1 (OOZIE-1613), which would make DistCp v2 available in Hadoop 1. The signatures of DistCp's constructor (where we can pass the tags property in a Configuration) should then be same. We can then duplicate what DistCp.main(...) does.

A more immediate solution would involve some ugly reflection based on different versions of Hadoop.

Issue Links

• contains: OOZIE-2039 queue configuration is not working for distcp action
• relates to: OOZIE-1613 Update Hadoop to 1.2.1
• links to: ReviewBoard