Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2889 Address remaining OYA issues
  3. OOZIE-2869

Ability to add/remove MapReduce jars from action classpath.

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.0.0
    • Fix Version/s: 5.0.0b1
    • Component/s: action
    • Labels:
      None

      Description

      Since Oozie On YARN doesn't fire a map only job to fire all the other applications (hence the transition from LauncherMapper to LauncherAM), no need to bundle the MapReduce JARs within Oozie's default sharelib.

      Nevertheless, it's a common, but discouraged use case that MapReduce tasks are fired using Java Action. So we need some default mapreduce sharelib that can be used by customers after OOZIE-2601 will have been implemented:

      1. by default, create a sharelib named mapreduce which will contain the MR jars using local paths as those jars are on every machine
      2. users can add mapreduce jars to any action using oozie.action.sharelib.for.ACTION just like now. They could add MR jars into Java, Spark or Shell actions easily

        Attachments

        1. OOZIE-2869.amend.001.patch
          5 kB
          Andras Piros
        2. OOZIE-2869.001.patch
          10 kB
          Peter Cseh

          Issue Links

            Activity

              People

              • Assignee:
                andras.piros Andras Piros
                Reporter:
                andras.piros Andras Piros
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: