[HBASE-26271] Cleanup the broken store files under data directory

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.5.0, 3.0.0-alpha-3
• Component/s: HFile
• Hadoop Flags: Reviewed
• Assignee: Szabolcs Bukros
• Reporter: Duo Zhang
• Created: 09/Sep/21 15:37
• Updated: 19/Mar/24 15:10
• Resolved: 09/Nov/21 16:19

Description

As for some new store file tracker implementation, we allow flush/compaction to write directly to data directory, so if we crash in the middle, there will be broken store files left in the data directory.

We should find a proper way to delete these broken files.

Issue Links

• breaks: HBASE-26938 Compaction failures after StoreFileTracker integration
• breaks: HBASE-26675 Data race on Compactor.writer
• links to: GitHub Pull Request #3707
• links to: GitHub Pull Request #3751
• links to: GitHub Pull Request #3786