Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12303

Change default EC cell size to 1MB for better performance

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Blocker
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 3.0.0-beta1
          • Component/s: None
          • Target Version/s:
          • Hadoop Flags:
            Incompatible change
          • Release Note:
            The cell size of the provided HDFS erasure coding policies has been changed from 64k to 1024k for better performance. The policy names have all been changed accordingly, i.e. RS-6-3.1024k.

            Description

            As discussed in HDFS-11814, 1MB cell size shows better performance than others during the tests.

              Attachments

              1. HDFS-12303.00.patch
                24 kB
                Wei Zhou
              2. HDFS-12303.01.patch
                28 kB
                Wei Zhou
              3. HDFS-12303.02.patch
                34 kB
                Wei Zhou

                Activity

                  People

                  • Assignee:
                    zhouwei Wei Zhou
                    Reporter:
                    zhouwei Wei Zhou
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    6 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: