[HDFS-8058] Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-7285
• Fix Version/s: HDFS-7285
• Target Version/s: HDFS-7285
• Hadoop Flags: Reviewed
• Assignee: Zhe Zhang
• Reporter: Yi Liu
• Created: 03/Apr/15 14:49
• Updated: 30/Sep/15 19:37
• Resolved: 15/Jul/15 16:49

Description

This JIRA is to use BlockInfo[] blocks for both striped and contiguous blocks in INodeFile.

Currently FileWithStripedBlocksFeature keeps separate list for striped blocks, and the methods there duplicate with those in INodeFile, and current code need to judge isStriped then do different things. Also if file is striped, the blocks in INodeFile occupy a reference memory space.
These are not necessary, and we can use the same blocks to make code more clear.

I keep FileWithStripedBlocksFeature as empty for follow use: I will file a new JIRA to move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile, since ideally they are the same for all striped blocks in a file, and store them in block will waste NN memory.

Issue Links

• is required by: HDFS-8059 Erasure coding: revisit how to store EC schema and cellSize in NameNode