[HDFS-16833] NameNode should log internal EC blocks instead of the EC block group when it receives block reports

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: erasure-coding
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Takanobu Asanuma
• Reporter: Takanobu Asanuma
• Created: 04/Nov/22 02:34
• Updated: 28/Jan/24 07:54
• Resolved: 07/Nov/22 01:50

Description

When creating an EC file, NN only logs the EC block group for each of the internal EC block. 

// replica file
2022-11-04 10:38:20,124 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11007 is added to blk_1073741825_1001 (size=1024)
2022-11-04 10:38:20,126 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11004 is added to blk_1073741825_1001 (size=1024)
2022-11-04 10:38:20,126 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11001 is added to blk_1073741825_1001 (size=1024)

// ec file
2022-11-04 10:39:02,376 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11008 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,381 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11000 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,383 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11001 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,385 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11007 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,387 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11009 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,389 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11004 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,390 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11006 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,393 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11002 is added to blk_-9223372036854775792_1002 (size=0)
2022-11-04 10:39:02,395 [Block report processor] INFO  BlockStateChange (BlockManager.java:addStoredBlock(3633)) - BLOCK* addStoredBlock: 127.0.0.1:11003 is added to blk_-9223372036854775792_1002 (size=0)

Issue Links

• links to: GitHub Pull Request #5106