[HDFS-11268] Correctly reconstruct erasure coding file from FSImage

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 3.0.0-alpha2
• Component/s: erasure-coding
• Labels: hdfs-ec-3.0-must-do
• Target Version/s: 3.0.0-alpha2
• Assignee: Sammi Chen
• Reporter: Sammi Chen
• Created: 22/Dec/16 02:28
• Updated: 02/Oct/19 17:15
• Resolved: 19/Jan/17 08:24

Description

Currently, FSImageFormatProtoBuf has the information about whether the file is striped or not and saved file's erasure coding policy ID in replication field. But later, when FSImage is loaded to create the name space, the default system erasure coding policy is used to reconstruct file's block structure. In case if the erasure coding policy of file is not the default erasure coding policy, the content of the file cannot be accessed correctly.