Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8793 Improve BlockManager memory and performance
  3. HDFS-8792

BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 2.8.0, 3.0.0-alpha1
          • Component/s: None
          • Labels:
            None
          • Target Version/s:

            Description

            LightWeightHashSet requires fewer memory than java hashset.

              Attachments

              1. HDFS-8792.001.patch
                2 kB
                Yi Liu
              2. HDFS-8792.002.patch
                6 kB
                Yi Liu
              3. HDFS-8792.003.patch
                6 kB
                Yi Liu

                Issue Links

                is related to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-11179 LightWeightHashSet can't remove blocks correctly which have a large number blockId

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      hitliuyi Yi Liu
                      Reporter:
                      hitliuyi Yi Liu
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      8 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: