[HBASE-12405] WAL accounting by Store

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0, 2.0.0
• Fix Version/s: 1.1.0, 2.0.0
• Component/s: wal
• Hadoop Flags: Reviewed
• Assignee: Duo Zhang
• Reporter: Duo Zhang
• Created: 31/Oct/14 23:59
• Updated: 08/Jun/15 03:48
• Resolved: 10/Mar/15 05:29

Description

HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so there are two problems:
1. We record minSeqId both in HRegion and FSHLog, which is a duplication.
2. There maybe holes in WAL accounting.
For example, assume family A with sequence id 1 and 3, family B with seqId 2. If we flush family A, we can only record that WAL before sequence id 1 can be removed safely. If we do a replay at this point, sequence id 3 will also be replayed which is unnecessary.

Issue Links

• is blocked by: HBASE-12715 getLastSequenceId always returns -1
• is related to: HBASE-10201 Port 'Make flush decisions per column family' to trunk
• links to: reviewboard