[HDFS-7663] Erasure Coding: Append on striped file

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 3.3.0
• Hadoop Flags: Reviewed
• Assignee: Ayush Saxena
• Reporter: Jing Zhao
• Created: 23/Jan/15 01:51
• Updated: 16/Aug/22 20:43
• Resolved: 05/Mar/19 14:02

Description

Append should be easy if we have variable length block support from HDFS-3689, i.e., the new data will be appended to a new block. We need to revisit whether and how to support appending data to the original last block.

1. Append to a closed striped file, with NEW_BLOCK flag enabled (this)
2. Append to a under-construction striped file, with NEW_BLOCK flag enabled (HDFS-9173)
3. Append to a striped file, by appending to last block group (follow-on)

This jira attempts to implement the #1, and also track #2, #3.

Issue Links

• blocks: HDFS-14581 Appending to EC files crashes NameNode
• is duplicated by: HDFS-7783 Support appending to a striping layout file
• is duplicated by: HDFS-11236 Erasure Coding cann't support appendToFile
• is required by: HDFS-15398 EC: hdfs client hangs due to exception during addBlock
• relates to: HDFS-16730 Update the doc that append to EC files is supported