[HDFS-2085] 1073: finalize inprogress edit logs at startup

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Edit log branch (HDFS-1073)
• Fix Version/s: Edit log branch (HDFS-1073)
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 20/Jun/11 18:22
• Updated: 21/Jun/11 20:14
• Resolved: 21/Jun/11 20:14

Description

With HDFS-2074, the NameNode can read through any "in-progress" logs it finds during startup to determine how many transactions they have. It can then re-name the file from its inprogress name to its finalized name. For example, if it finds a file edits_10_inprogress with 3 transactions, it can rename it to edits_10-12 at startup. This means that other parts of the system like edits-log-transfer don't need to worry about in-progress logs.

Issue Links

• is blocked by: HDFS-2074 1073: determine edit log validity by truly reading and validating transactions