Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1658

Add bundle, coord, wf and action related information to launched M/R jobs.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.1.0
    • None
    • None

    Description

      We should add workflow related information to launched job. This information can be used for analytics like how many oozie jobs are submitted for a particular period, what is the total number of failed pig jobs.. etc from mapreduce jobhistory logs and configuration.

      JobInfo will contain information of bundle, coordinator, workflow and actions. If enabled, Hadoop job will have
      property(oozie.job.info) which value is multiple key/value pair separated by ";".

      User can also add custom workflow property to jobinfo by adding property which prefix with "oozie.job.info."

      Eg.
      oozie.job.info="bundle.id=;bundle.name=;coord.name=;coord.nominal.time=;coord.name=;wf.id=;
      wf.name=;action.name=;action.type=;launcher=true"

      Jobinfo can enabled/disabled using "oozie.action.jobinfo.enable"

      Attachments

        1. OOZIE-1658-v2.patch
          25 kB
          Purshotam Shah
        2. OOZIE-1658-v1.patch
          25 kB
          Purshotam Shah
        3. OOZIE-1658.patch
          25 kB
          Purshotam Shah

        Issue Links

          Activity

            People

              puru Purshotam Shah
              puru Purshotam Shah
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: