Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
Description
Sometimes, the users have a semi-complicated pipeline that needs to run in slightly different ways depending on whether they are running against live data, reprocessing recent data, or reprocessing historical data from another cluster. Instead of having to create multiple different bundles to capture these various cases, it would be good to have some sort of conditional logic in the bundle XML file that users can use to enable or disable specific coordinators within the bundle based on the properties passed in. That way, we can control, either from the properties file or from oozie command line options, the coordinators that get run and the mode that overall pipeline is processing in.
Ideally, this would be supported by extending the <coordinator> tag with a new "enabled" attribute that takes a boolean expression and supports standard expression syntax and functions.