[HDFS-15315] IOException on close() when using Erasure Coding

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.1
• Component/s: 3.1.1, ec, hdfs

Environment

XOR-2-1-1024k policy on hadoop 3.1.1 with 3 datanodes

• Assignee: Zhao Yi Ming
• Reporter: Anshuman Singh
• Created: 30/Apr/20 13:22
• Updated: 22/May/20 07:22

Description

When using Erasure Coding policy on a directory, the replication factor is set to 1. Solr fails in indexing documents with error - java.io.IOException: Unable to close file because the last block does not have enough number of replicas. It works fine without EC (with replication factor as 3.) It seems to be identical to this issue. [ https://issues.apache.org/jira/browse/HDFS-11486|https://issues.apache.org/jira/browse/HDFS-11486]

Issue Links

• relates to: HDFS-15359 EC: Allow closing a file with committed blocks