Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-764

The memory consumption of processReport() in the namenode can be reduced

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.10.0
    • None
    • None

    Description

      The FSNamesystem.processReport() method converts the blocklist for a datanode into an array by calling node.getBlocks(). Although this memory allocation is transient, it could possibly require the garbage-collector to work that much harder.

      The method Block.getBlocks() should be deprecated. Code that currently uses this method should instead iterate over the Collection.

      Attachments

        1. processBlockReport3.patch
          3 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            dhruba Dhruba Borthakur
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: