[HBASE-22075] Potential data loss when MOB compaction fails

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Won't Fix
• Affects Version/s: 2.1.0, 2.0.0, 2.0.1, 2.1.1, 2.0.2, 2.0.3, 2.1.2, 2.0.4, 2.1.3
• Component/s: mob
• Labels: compaction mob
• Release Note: Addressed by reimplementing compaction in HBASE-22749
• Assignee: Unassigned
• Reporter: Vladimir Rodionov
• Created: 20/Mar/19 23:02
• Updated: 05/Mar/20 17:34
• Resolved: 05/Mar/20 17:32

Description

When MOB compaction fails during last step (bulk load of a newly created reference file) there is a high chance of a data loss due to partially loaded reference file, cells of which refer to (now) non-existent MOB file. The newly created MOB file is deleted automatically in case of a MOB compaction failure, but some cells with the references to this file might be loaded to HBase.

Issue Links

• relates to: HBASE-23353 MOB throws FileNotFound
• relates to: HBASE-23222 Better logging and mitigation for MOB compaction failures
• relates to: HBASE-22749 Distributed MOB compactions
• relates to: HBASE-23239 Reporting on status of backing MOB files from client-facing cells