Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1722 When an ApplicationMaster restarts, it restarts the launcher job
  3. OOZIE-1728

When an ApplicationMaster restarts, it restarts the launcher job: DistCp followup

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk
    • Fix Version/s: 4.2.0
    • Component/s: None
    • Labels:
      None

      Description

      In doing OOZIE-1722, we had not not add support for the DistCp action because there wasn't a good clean way to set the mapreduce.job.tags property on the job launched by DistCp that would work between all versions of Hadoop.

      The best solution would be to switch our version of Hadoop 1 to Hadoop 1.2.1 (OOZIE-1613), which would make DistCp v2 available in Hadoop 1. The signatures of DistCp's constructor (where we can pass the tags property in a Configuration) should then be same. We can then duplicate what DistCp.main(...) does.

      A more immediate solution would involve some ugly reflection based on different versions of Hadoop.

        Attachments

        1. OOZIE-1728-v2.patch
          24 kB
          Ryota Egashira
        2. OOZIE-1728-v2.patch
          24 kB
          Ryota Egashira

          Issue Links

            Activity

              People

              • Assignee:
                egashira Ryota Egashira
                Reporter:
                rkanter Robert Kanter
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: