Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12303

Change default EC cell size to 1MB for better performance

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 3.0.0-beta1
    • None
    • Incompatible change
    • The cell size of the provided HDFS erasure coding policies has been changed from 64k to 1024k for better performance. The policy names have all been changed accordingly, i.e. RS-6-3.1024k.

    Description

      As discussed in HDFS-11814, 1MB cell size shows better performance than others during the tests.

      Attachments

        1. HDFS-12303.00.patch
          24 kB
          Wei Zhou
        2. HDFS-12303.01.patch
          28 kB
          Wei Zhou
        3. HDFS-12303.02.patch
          34 kB
          Wei Zhou

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhouwei Wei Zhou
            zhouwei Wei Zhou
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment