Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5710

Counter MAP_INPUT_BYTES missing from new mapreduce api.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      MapTask, with current new mapreduce api, does not maintain MAP_INPUT_BYTES counter. Since RecordReader doesnot have getPos() api, it is not possible for the map task to maintain. Individual record readers (LineRecordReader, SequenceFileRecordReader) could be modified to maintain the same.

        Attachments

        1. patch-5710-3.txt
          13 kB
          Amareshwari Sriramadasu
        2. patch-5710-2.txt
          13 kB
          Amareshwari Sriramadasu
        3. patch-5710-1.txt
          11 kB
          Amareshwari Sriramadasu
        4. patch-5710.txt
          4 kB
          Amareshwari Sriramadasu

        Issue Links

          Activity

            People

            • Assignee:
              amareshwari Amareshwari Sriramadasu
              Reporter:
              amareshwari Amareshwari Sriramadasu

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment