Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1168 Native Scheduler in Falcon - Umbrella JIRA
  3. FALCON-1231

Improve JobCompletionNotification Service

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8
    • None
    • None

    Description

      Workflow completion is currently dependent on post processing action putting messages (success/failure) to a JMS queue.

      When failures occur on Hadoop / Oozie, the post processing action may not get executed either. In such cases, Falcon will be blind to the status of the workflow and re-tries will not happen.

      Explore url notification of oozie to get job completion notifications. Fall back on polling when workflows run beyond SLA.

      Attachments

        1. OozieJobStatusNotification.pdf
          63 kB
          Pallavi Rao
        2. FALCON-1231-v3.patch
          71 kB
          Pallavi Rao
        3. FALCON-1231-v2.patch
          72 kB
          Pallavi Rao
        4. FALCON-1231-v1.patch
          63 kB
          Pallavi Rao
        5. FALCON-1231-v1.patch
          63 kB
          Pallavi Rao
        6. FALCON-1231.patch
          61 kB
          Pallavi Rao
        7. FALCON-1231.patch
          63 kB
          Pallavi Rao

        Issue Links

          is required by

          Improvement - An improvement or enhancement to an existing feature or task. FALCON-1405 Oozie workflow should not fail if post-processing fails

          • Major - Major loss of function.
          • Open
          links to

          Web Link Review Board link

          Activity

            People

              pallavi.rao Pallavi Rao
              pallavi.rao Pallavi Rao
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: