[HDFS-10697] Erasure Code(6:3) can not work, using get fs shell when 2 datanode down

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.0.0-alpha2
• Component/s: erasure-coding

Environment

9 datanodes 2 HA name node and Yarn

• Target Version/s: 3.0.0-alpha2
• Assignee: Unassigned
• Reporter: Alberic Liu
• Created: 27/Jul/16 12:48
• Updated: 29/Jul/16 11:26
• Resolved: 29/Jul/16 11:26

Description

I can put file into EC folder(6:3), and get the file successfully.
But when I shutdown one datanode, I still can get the file, using hdfs dfs -get.
But when I shutdown two datanodes, when i use hdfs dfs -get, I get following error:
get: 4 missing blocks, the stripe is: Offset=786432, length=65536, fetchedChunksNum=5, missingChunksNum=4; locatedBlocks is: LocatedBlocks{

Issue Links

• relates to: HDFS-10586 Erasure Code misfunctions when 3 DataNode down