[HDFS-12394] Erasure coding policy cell size should not be greater than file block size

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha4
• Component/s: erasure-coding
• Labels: hdfs-ec-3.0-nice-to-have
• Assignee: Wei Zhou
• Reporter: Sammi Chen
• Created: 05/Sep/17 06:15
• Updated: 18/Jan/18 07:47

Description

Current the minimum block size is defined by "dfs.namenode.fs-limits.min-block-size" with default value 1MB. Default block size is defined by "dfs.blocksize" with default value 128MB. Maximum erasure coding policy cell size is defined by "dfs.namenode.ec.policies.max.cellsize" with default value 4MB. We need to make sure the erasure coding policy cell size should not be greater than file block size. Otherwise file read/write will fail.