Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10934

AbstractCounters.readFields doesn't clear "other" groups

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.2.0, 2.3.0, 2.4.0, 2.4.1
    • None
    • None
    • None

    Description

      The readFields method of AbstractCounters clears the "framework and fs groups" map fgroups, but does not clear the "other groups" map groups. If a Counters object is used as the key or value record reader, it will aggregate groups over all records rather than just returning the counters for the current record. In all likelihood, in addition to providing incorrect data, the counter limit will also be exceeded as it is checked each time through readFields.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6199 AbstractCounters are not reset completely on deserialization

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              bfloss Brian Loss
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: