[BIGTOP-1376] Split Oozie package into several small packages

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Guodong Wang
• Created: 14/Jul/14 08:28
• Updated: 14/Jul/14 14:52

Description

Oozie can manage hive/pig/sqoop actions, while user do not need to enable them all. It is better to provide a way for user to enable them.

My proposal is like what bigtop has done in Hue packaging, split the functions as separate plugin package.

1. provide packages: oozie-hive, oozie-sqoop, oozie-pig. Each of them depends on hive, sqoop and pig respectively.
2. In each package, use the symlinks to manage the dependency jars. For example, if oozie-hive is installed, some symlinks are created under /usr/lib/oozie/share/lib/hive/.
3. After install oozie-hive/oozie-sqoop/oozie-pig packages, users need to do sharelib upgrade with oozie-setup script.

We can have the following benifits with this proposal

1. No dependency jars are in Oozie packages. All dependency jars are managed by symlinks.
2. Recently, BIGTOP-1349 was found in our cluster. If using this proposal, this issue can be solved. Because oozie-hive depends on hive. If user enable oozie-hive plugin, hive jars are installed on Oozie node.