Pig
  1. Pig
  2. PIG-1280

Add a pig-script-id to the JobConf of all jobs run in a pig-script

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.
      Show
      A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.

      Description

      It would be very useful for tools like gridmix if pig could add a 'pig-script-id' to all Map-Reduce jobs spawned by a single pig-script. Potentially we could use this to re-construct the DAG of jobs in gridmix and so on.

      1. PIG-1280.patch
        18 kB
        Richard Ding
      2. PIG-1280.patch
        13 kB
        Richard Ding

        Issue Links

          Activity

          Olga Natkovich made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Richard Ding made changes -
          Release Note A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to the job conf (and so being persisted in the job xml). The default value is true. To turn off this feature, set the value to false. A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to all MR jobs produced by the script (and so being persisted in the job xmls). The default value is true. To turn off this feature, set the value to false.
          Richard Ding made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Release Note A new Pig property ("pig.script.info.enabled") is added to the pig-default.properties file that allows Pig to add the user script, input dirs, and other script related settings to the job conf (and so being persisted in the job xml). The default value is true. To turn off this feature, set the value to false.
          Resolution Fixed [ 1 ]
          Richard Ding made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Richard Ding made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Richard Ding made changes -
          Attachment PIG-1280.patch [ 12444425 ]
          Richard Ding made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Richard Ding made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Richard Ding made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Richard Ding made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Richard Ding made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Richard Ding made changes -
          Attachment PIG-1280.patch [ 12444018 ]
          Richard Ding made changes -
          Link This issue is related to PIG-62 [ PIG-62 ]
          Richard Ding made changes -
          Fix Version/s 0.8.0 [ 12314562 ]
          Richard Ding made changes -
          Field Original Value New Value
          Assignee Richard Ding [ rding ]
          Arun C Murthy created issue -

            People

            • Assignee:
              Richard Ding
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development