[HBASE-16392] Backup delete fault tolerance

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Labels: backup
• Hadoop Flags: Reviewed
• Assignee: Vladimir Rodionov
• Reporter: Vladimir Rodionov
• Created: 10/Aug/16 22:16
• Updated: 07/Jun/17 05:37
• Resolved: 07/Jun/17 03:29

Description

Backup delete modified file system and backup system table. We have to make sure that operation is atomic, durable and isolated.

Delete operation:

1. Start backup session (this guarantees) that system will be blocked for all backup commands during delete operation
2. Save list of tables being deleted to system table
3. Before delete operation we take backup system table snapshot
4. During delete operation we detect any failures and restore backup system table from snapshot, then finish backup session
5. To guarantee consistency of the data, delete operation MUST be repeated
6. We guarantee that all file delete operations are idempotent, can be repeated multiple times
7. Any backup operations will be blocked until consistency is restored
8. To restore consistency, repair command must be executed.
9. Repair command checks if there is failed delete op in a backup system table, and repeats delete operation

Issue Links

• relates to: HBASE-16197 Enhance backup delete command