Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1658

Add bundle, coord, wf and action related information to launched M/R jobs.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.1.0
    • Component/s: None
    • Labels:
      None

      Description

      We should add workflow related information to launched job. This information can be used for analytics like how many oozie jobs are submitted for a particular period, what is the total number of failed pig jobs.. etc from mapreduce jobhistory logs and configuration.

      JobInfo will contain information of bundle, coordinator, workflow and actions. If enabled, Hadoop job will have
      property(oozie.job.info) which value is multiple key/value pair separated by ";".

      User can also add custom workflow property to jobinfo by adding property which prefix with "oozie.job.info."

      Eg.
      oozie.job.info="bundle.id=;bundle.name=;coord.name=;coord.nominal.time=;coord.name=;wf.id=;
      wf.name=;action.name=;action.type=;launcher=true"

      Jobinfo can enabled/disabled using "oozie.action.jobinfo.enable"

        Attachments

        1. OOZIE-1658.patch
          25 kB
          Purshotam Shah
        2. OOZIE-1658-v1.patch
          25 kB
          Purshotam Shah
        3. OOZIE-1658-v2.patch
          25 kB
          Purshotam Shah

          Issue Links

            Activity

              People

              • Assignee:
                puru Purshotam Shah
                Reporter:
                puru Purshotam Shah
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: