Major Description
Since Oozie On YARN doesn't fire a map only job to fire all the other applications (hence the transition from LauncherMapper to LauncherAM), no need to bundle the MapReduce JARs within Oozie's default sharelib.
Nevertheless, it's a common, but discouraged use case that MapReduce tasks are fired using Java Action. So we need some default mapreduce sharelib that can be used by customers after OOZIE-2601 will have been implemented:
- by default, create a sharelib named mapreduce which will contain the MR jars using local paths as those jars are on every machine
- users can add mapreduce jars to any action using oozie.action.sharelib.for.ACTION just like now. They could add MR jars into Java, Spark or Shell actions easily
Attachments
Attachments
Issue Links
- breaks
-
OOZIE-3159 Spark Action fails because of absence of hadoop mapreduce jar(s)
-
- Closed
-
- is duplicated by
-
OOZIE-2686 OYA: Find places where to add MR specific classes/configs instead of handling them in JavaActionExecutor
-
- Resolved
-
- links to
