[HBASE-28456] HBase Restore restores old data if data for the same timestamp is in different hfiles

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.6.0, 3.0.0-beta-2
• Component/s: backup&restore
• Labels: pull-request-available
• Assignee: Bryan Beaudreault
• Reporter: Ruben Van Wanzeele
• Created: 23/Mar/24 21:04
• Updated: 27/Mar/24 20:27
• Resolved: 26/Mar/24 14:50

Description

The restore brings back 'old' data when executing restore.

It feels like the hfile sequence id is not respected during the restore.

See testing code attached. The workaround solution is to trigger major compaction before doing the backup (not really feasible for daily backups)

We didn't investigate this yet, but this might also impact the merge of multiple incremental backups (since that follows a similar code path merging hfiles).

This currently blocks our support for HBase backup and restore.

Willing to participate in a solution if necessary.

Issue Links

• links to: GitHub Pull Request #5775