Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1280

Add a pig-script-id to the JobConf of all jobs run in a pig-script

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.
      Show
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.

      Description

      It would be very useful for tools like gridmix if pig could add a 'pig-script-id' to all Map-Reduce jobs spawned by a single pig-script. Potentially we could use this to re-construct the DAG of jobs in gridmix and so on.

        Attachments

        1. PIG-1280.patch
          18 kB
          Richard Ding
        2. PIG-1280.patch
          13 kB
          Richard Ding

          Issue Links

            Activity

              People

              • Assignee:
                rding Richard Ding
                Reporter:
                acmurthy Arun C Murthy
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: