Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2444

Need conditional logic in bundles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 4.3.0
    • None
    • None

    Description

      Sometimes, the users have a semi-complicated pipeline that needs to run in slightly different ways depending on whether they are running against live data, reprocessing recent data, or reprocessing historical data from another cluster. Instead of having to create multiple different bundles to capture these various cases, it would be good to have some sort of conditional logic in the bundle XML file that users can use to enable or disable specific coordinators within the bundle based on the properties passed in. That way, we can control, either from the properties file or from oozie command line options, the coordinators that get run and the mode that overall pipeline is processing in.

      Ideally, this would be supported by extending the <coordinator> tag with a new "enabled" attribute that takes a boolean expression and supports standard expression syntax and functions.

      Attachments

        1. OOZIE-2444-5.patch
          0.8 kB
          Satish Saley
        2. OOZIE-2444-4-Doc.patch
          2 kB
          Satish Saley
        3. OOZIE-2444-3.patch
          13 kB
          Satish Saley
        4. OOZIE-2444-2.patch
          10 kB
          Satish Saley
        5. OOZIE-2444-1.patch
          11 kB
          Satish Saley

        Activity

          People

            satishsaley Satish Saley
            satishsaley Satish Saley
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: