Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3913

Pig should use job's jobClient wherever possible (fixes local mode counters)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      MapreduceLauncher initializes a statsJobClient to poll counter information of jobs. This works fine in mapreduce mode but it reports incorrect information in local (auto-local) mode. Pig code should try to use org.apache.hadoop.mapred.jobcontrol.Job's getJobClient api to get handle to jobClient wherever possible. statsJobClient (and wherever its references are passed) should be deprecated.

        Attachments

        1. PIG-3913-1.patch
          8 kB
          Aniket Mokashi
        2. PIG-3913-MRv2.v01.patch
          27 kB
          Gera Shegalov
        3. PIG-3913-3.patch
          29 kB
          Aniket Mokashi
        4. PIG-3913-5.patch
          30 kB
          Aniket Mokashi
        5. PIG-3913-6.patch
          31 kB
          Aniket Mokashi
        6. PIG-3913-7.patch
          30 kB
          Aniket Mokashi

          Issue Links

            Activity

              People

              • Assignee:
                aniket486 Aniket Mokashi
                Reporter:
                aniket486 Aniket Mokashi
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: