[HDFS-17126] FsDataSetImpl#checkAndUpdate should delete duplicated block meta file.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: datanode
• Target Version/s: 3.5.0
• Assignee: farmmamba Assign to me
• Reporter: farmmamba
• Created: 26/Jul/23 15:28
• Updated: 04/Jan/24 08:04

Description

Think about below case :

We have one datanode called dn1,   it has two storages call ds1 and ds2 respectively.

Suppose we have blk_123 and blk_123_1001.meta in ds1 and blk_123_1001.meta in ds2.

The current logic will not handle the file blk_123_1001.meta in ds2 and only prints logs to tell us DirectoryScanner scan missing block files.

I think we should do something here.