[HBASE-23353] MOB throws FileNotFound

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.1.1, 2.2.2
• Component/s: mob
• Assignee: Unassigned
• Reporter: Bo Cui
• Created: 30/Nov/19 02:36
• Updated: 30/Nov/19 03:19

Description

in PartitionedMobCompactor#bulkloadRefFile

If region num is changed from 1 to 20

bulkload will fail and we will get an exception (because the bulkload maxRetries is 10，hbase.bulkload.retries.number)

and then delete bulkload path and new MobFile,

old mob file is not deleted. 

but some hfiles have been successfully loaded through bulkload and not deleted.

And then,,,, get rowkey,,,,throw filenotfound

solution : write multiple hfiles and reduce split hfiles. because the data of scanner is ordered，we just need to open a hfile at the same time, when the current data dose not belong to the current hfile, we can close hfile and create new hfile.

 

Issue Links

• is related to: HBASE-22075 Potential data loss when MOB compaction fails