Pig
  1. Pig
  2. PIG-1280

Add a pig-script-id to the JobConf of all jobs run in a pig-script

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.
      Show
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.

      Description

      It would be very useful for tools like gridmix if pig could add a 'pig-script-id' to all Map-Reduce jobs spawned by a single pig-script. Potentially we could use this to re-construct the DAG of jobs in gridmix and so on.

      1. PIG-1280.patch
        18 kB
        Richard Ding
      2. PIG-1280.patch
        13 kB
        Richard Ding

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Richard Ding
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development