Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3913

Pig should use job's jobClient wherever possible (fixes local mode counters)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • None
    • None

    Description

      MapreduceLauncher initializes a statsJobClient to poll counter information of jobs. This works fine in mapreduce mode but it reports incorrect information in local (auto-local) mode. Pig code should try to use org.apache.hadoop.mapred.jobcontrol.Job's getJobClient api to get handle to jobClient wherever possible. statsJobClient (and wherever its references are passed) should be deprecated.

      Attachments

        1. PIG-3913-MRv2.v01.patch
          27 kB
          Gera Shegalov
        2. PIG-3913-7.patch
          30 kB
          Aniket Namadeo Mokashi
        3. PIG-3913-6.patch
          31 kB
          Aniket Namadeo Mokashi
        4. PIG-3913-5.patch
          30 kB
          Aniket Namadeo Mokashi
        5. PIG-3913-3.patch
          29 kB
          Aniket Namadeo Mokashi
        6. PIG-3913-1.patch
          8 kB
          Aniket Namadeo Mokashi

        Issue Links

          Activity

            People

              aniket486 Aniket Namadeo Mokashi
              aniket486 Aniket Namadeo Mokashi
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: