Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-410

Using HashMap instead of TreeMap for some maps in Namenode yields 17% performance improvement

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.5.0
    • 0.5.0
    • None
    • None
    • linux

    Description

      For blocksMap in FSNameSystem and activeBlocks map in FSDirectory, if we use HashMap instead of TreeMap, it yields 17% performance improvement (without significant difference in memory consumption).
      I am attaching a patch, alongwith a namenode benchmark.

      Attachments

        1. hashmap.patch
          10 kB
          Milind Barve

        Activity

          People

            milindb Milind Barve
            milindb Milind Barve
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: