Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2446

Fix map input bytes for hadoop 20.203+

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.2, 0.10.0, 0.11
    • Fix Version/s: 0.18.0
    • Component/s: impl
    • Labels:
      None

      Description

      From hadoop 20.203+, HDFS_BYTES_READ change the meaning. It no longer means the size of input files, it is the total hdfs bytes read for the job. Pig need a way to get the map input bytes to retain the old behavior.

      TestPigRunner.testGetHadoopCounters is testing that and is temporary disabled for hadoop 203+.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                daijy Daniel Dai
                Reporter:
                daijy Daniel Dai
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: