Details
-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: QuorumJournalManager (HDFS-3077)
-
Fix Version/s: QuorumJournalManager (HDFS-3077)
-
Component/s: ha
-
Labels:None
-
Hadoop Flags:Reviewed
Description
Per some discussion with Chao Shi here, we should keep track of the "last committed txid" on each JournalNode. Then during any recovery operation, we can sanity-check that we aren't asked to truncate a log to an earlier transaction.
This is also a necessary step if we want to support reading from in-progress segments in the future (since we should only allow reads up to the commit point)