[TEPHRA-235] Flushes and compactions can remove committed data

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.11.0-incubating, 0.12.0-incubating
• Fix Version/s: 0.13.0-incubating
• Component/s: core
• Assignee: Ali Anwar
• Reporter: Poorna Chandra
• Created: 20/Jun/17 00:54
• Updated: 22/Jun/17 18:34
• Resolved: 22/Jun/17 18:34

Description

Transaction co-processor uses the transaction snapshot generated by the Transaction Manager to remove deleted and invalid cells during HBase compactions and flushes. The co-processor expects the invalid list in the transaction snapshot to be sorted. However, the invalid list is not sorted during a snapshot creation in the Transaction Manager. This leads to invalid transactions becoming visible during compactions, and thus committed transactions with write pointers smaller than the invalid transaction will get removed.

We missed this piece when fixing TEPHRA-223.

Issue Links

• relates to: TEPHRA-223 Transactions started after a snapshot restore can have incorrect invalid transaction list
• links to: GitHub Pull Request #44