Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5710

Counter MAP_INPUT_BYTES missing from new mapreduce api.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      MapTask, with current new mapreduce api, does not maintain MAP_INPUT_BYTES counter. Since RecordReader doesnot have getPos() api, it is not possible for the map task to maintain. Individual record readers (LineRecordReader, SequenceFileRecordReader) could be modified to maintain the same.

        Attachments

        1. patch-5710-3.txt
          13 kB
          Amareshwari Sriramadasu
        2. patch-5710-2.txt
          13 kB
          Amareshwari Sriramadasu
        3. patch-5710-1.txt
          11 kB
          Amareshwari Sriramadasu
        4. patch-5710.txt
          4 kB
          Amareshwari Sriramadasu

          Issue Links

            Activity

              People

              • Assignee:
                amareshwari Amareshwari Sriramadasu
                Reporter:
                amareshwari Amareshwari Sriramadasu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: