Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3812

Several clean-ups in PigStats and JobStats

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • None
    • None

    Description

      While implementing counter support in Pig-on-Tez (PIG-3603), I made several changes to PigStats and JobStats classes. To avoid breaking backward compatibility between 0.13 and 0.13+, I'd like to commit this patch into trunk prior to 0.13 release.

      The changes include-

      1. Move getHdfsBytes[Read|Written]() from MRPigStatsUtil to PigStatsUtil since these are not MR specific.
      2. Move [MAP|REDUCE]_[IN|OUT]PUT_RECORDS from MRPigStatsUtil to PigStatsUtil since Tez MRInput and MROutput also use them.
      3. Fix a typo in JobStats#getAvgREduceTime(): REduce -> Reduce.
      4. Fix white spaces.

      Attachments

        1. PIG-3812-2.patch
          37 kB
          Cheolsoo Park
        2. PIG-3812-1.patch
          20 kB
          Cheolsoo Park

        Activity

          People

            cheolsoo Cheolsoo Park
            cheolsoo Cheolsoo Park
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: