Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1280

Add a pig-script-id to the JobConf of all jobs run in a pig-script

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • impl
    • None
    • Reviewed
    • Hide
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.
      Show
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.

    Description

      It would be very useful for tools like gridmix if pig could add a 'pig-script-id' to all Map-Reduce jobs spawned by a single pig-script. Potentially we could use this to re-construct the DAG of jobs in gridmix and so on.

      Attachments

        1. PIG-1280.patch
          13 kB
          Richard Ding
        2. PIG-1280.patch
          18 kB
          Richard Ding

        Issue Links

          Activity

            People

              rding Richard Ding
              acmurthy Arun Murthy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: