Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2648

Child jobs shouldn't send callbacks to Oozie

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • trunk
    • 4.3.0
    • None
    • None

    Description

      I noticed that all action.xml files end up having job.end.notification.url set to send the callback to the Oozie Server when they finish. This makes it so that all child MR jobs have this, and send notifications to the Oozie Server. This isn't the end of the world, but it's unnecessary, especially if you end up with multiple child jobs (e.g. a Hive Action that spawns multiple MR jobs). We should consider only adding it to the Launcher Job. The exception to this is the MapReduce Action, where the Launcher Job exits early and Oozie directly monitors the MR child; in this case, the child should have it and the Launcher should not.

      The call in JavaActionExecutor to injectActionCallback(context, actionConf); is where this happens.

      Attachments

        1. OOZIE-2648-00.patch
          2 kB
          Abhishek Bafna

        Activity

          People

            abhishekbafna Abhishek Bafna
            rkanter Robert Kanter
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: