Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1114

Reducing NameNode memory usage by an alternate hash table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.22.0
    • namenode
    • None
    • Reviewed

    Description

      NameNode uses a java.util.HashMap to store BlockInfo objects. When there are many blocks in HDFS, this map uses a lot of memory in the NameNode. We may optimize the memory usage by a light weight hash table implementation.

      Attachments

        1. benchmark20100618.patch
          4 kB
          Tsz-wo Sze
        2. GSet20100525.pdf
          105 kB
          Tsz-wo Sze
        3. gset20100608.pdf
          105 kB
          Tsz-wo Sze
        4. gset20100702.pdf
          107 kB
          Tsz-wo Sze
        5. gset20100702.tex
          14 kB
          Tsz-wo Sze
        6. h1114_20100607.patch
          14 kB
          Tsz-wo Sze
        7. h1114_20100614b.patch
          24 kB
          Tsz-wo Sze
        8. h1114_20100615.patch
          25 kB
          Tsz-wo Sze
        9. h1114_20100616b.patch
          27 kB
          Tsz-wo Sze
        10. h1114_20100617.patch
          27 kB
          Tsz-wo Sze
        11. h1114_20100617b_y0.20.1xx.patch
          27 kB
          Tsz-wo Sze
        12. h1114_20100617b.patch
          27 kB
          Tsz-wo Sze
        13. h1114_20100617b2_y0.20.1xx.patch
          27 kB
          Tsz-wo Sze

        Activity

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: