Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12303

Change default EC cell size to 1MB for better performance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-beta1
    • Component/s: None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      The cell size of the provided HDFS erasure coding policies has been changed from 64k to 1024k for better performance. The policy names have all been changed accordingly, i.e. RS-6-3.1024k.

      Description

      As discussed in HDFS-11814, 1MB cell size shows better performance than others during the tests.

        Attachments

        1. HDFS-12303.00.patch
          24 kB
          Wei Zhou
        2. HDFS-12303.01.patch
          28 kB
          Wei Zhou
        3. HDFS-12303.02.patch
          34 kB
          Wei Zhou

          Activity

            People

            • Assignee:
              zhouwei Wei Zhou
              Reporter:
              zhouwei Wei Zhou
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: