[HDFS-15359] EC: Allow closing a file with committed blocks

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: erasure-coding
• Target Version/s: 3.4.0, 3.3.2
• Hadoop Flags: Reviewed
• Assignee: Ayush Saxena
• Reporter: Ayush Saxena
• Created: 16/May/20 13:28
• Updated: 27/Jan/24 03:22
• Resolved: 05/Jun/20 13:49

Description

Presently, dfs.namenode.file.close.num-committed-allowed is ignored in case of EC blocks. But in case of heavy loads, IBR's from Datanode may get delayed and cause the file write to fail. So, can allow EC files to close with blocks in committed state as REP files

Issue Links

• is related to: HDFS-15315 IOException on close() when using Erasure Coding
• is related to: HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.
• relates to: HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.