[HDFS-17243] Add the parameter storage type for getBlocks method

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: balancer & mover
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Haiyang Hu
• Reporter: Haiyang Hu
• Created: 29/Oct/23 12:39
• Updated: 16/Oct/24 18:30
• Resolved: 06/Nov/23 04:21

Description

When Balancer is running, it is found that there are many logs, such as

INFO  balancer.Dispatcher (Dispatcher.java:markMovedIfGoodBlock(306)) - No striped internal block on source xxx:50010:SSD, block blk_-xxx_xxx size=982142783. Skipping.

these logs show that Balancer cannot to balancer SSD type source， and it causes that Balancer will frequently get blocks from NN through getBlocks RPC.

The main reason is the storage type in the current Source is SSD, but now getBlocks obtains all list of blocks belonging to datanode, so need add the parameter storage type for getBlocks method

Issue Links

• links to: GitHub Pull Request #6238