Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-803

Reducing memory consumption on Namenode : Part 1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      There appears to be some places in Namenode that allow reducing memory consumption without intrusive code or feature changes. This bug is an initial attempt making those changes. Please include your thoughts as well.

      One change I am planning to make :

      Currently one copy of each block exists for each of the replicas and one copy for blockMap. I think they are all supposed to be same.

      Attachments

        1. NameNodeMemoryHogs.txt
          1 kB
          Raghu Angadi
        2. HADOOP-803-2.patch
          13 kB
          Raghu Angadi
        3. HADOOP-803.patch
          13 kB
          Raghu Angadi
        4. HADOOP-803_5.patch
          18 kB
          Raghu Angadi
        5. HADOOP-803_4.patch
          18 kB
          Doug Cutting
        6. HADOOP-803_3.patch
          18 kB
          Raghu Angadi
        7. block-refs-5.patch
          8 kB
          Raghu Angadi
        8. block-refs-3.patch
          8 kB
          Raghu Angadi
        9. block-refs-2.patch
          6 kB
          Raghu Angadi

        Activity

          People

            rangadi Raghu Angadi
            rangadi Raghu Angadi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: