Hadoop Common
  1. Hadoop Common
  2. HADOOP-5710

Counter MAP_INPUT_BYTES missing from new mapreduce api.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      MapTask, with current new mapreduce api, does not maintain MAP_INPUT_BYTES counter. Since RecordReader doesnot have getPos() api, it is not possible for the map task to maintain. Individual record readers (LineRecordReader, SequenceFileRecordReader) could be modified to maintain the same.

      1. patch-5710.txt
        4 kB
        Amareshwari Sriramadasu
      2. patch-5710-1.txt
        11 kB
        Amareshwari Sriramadasu
      3. patch-5710-2.txt
        13 kB
        Amareshwari Sriramadasu
      4. patch-5710-3.txt
        13 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          Amareshwari Sriramadasu created issue -
          Amareshwari Sriramadasu made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-5696 [ HADOOP-5696 ]
          Amareshwari Sriramadasu made changes -
          Link This issue is blocked by HADOOP-5717 [ HADOOP-5717 ]
          Amareshwari Sriramadasu made changes -
          Attachment patch-5710.txt [ 12406908 ]
          Amareshwari Sriramadasu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amareshwari Sriramadasu made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Amareshwari Sriramadasu made changes -
          Attachment patch-5710-1.txt [ 12408553 ]
          Amareshwari Sriramadasu made changes -
          Attachment patch-5710-2.txt [ 12408678 ]
          Amareshwari Sriramadasu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Amareshwari Sriramadasu made changes -
          Attachment patch-5710-3.txt [ 12408938 ]
          Sharad Agarwal made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Amareshwari Sriramadasu
              Reporter:
              Amareshwari Sriramadasu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development