[HDFS-3540] Further improvement on recovery mode and edit log toleration in branch-1

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.0
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Tsz-wo Sze
• Reporter: Tsz-wo Sze
• Created: 15/Jun/12 21:51
• Updated: 15/May/13 05:15
• Resolved: 23/Oct/12 01:11

Description

Recovery Mode: HDFS-3479 backported HDFS-3335 to branch-1. However, the recovery mode feature in branch-1 is dramatically different from the recovery mode in trunk since the edit log implementations in these two branch are different. For example, there is UNCHECKED_REGION_LENGTH in branch-1 but not in trunk.

Edit Log Toleration: HDFS-3521 added this feature to branch-1 to remedy UNCHECKED_REGION_LENGTH and to tolerate edit log corruption.

There are overlaps between these two features. We study potential further improvement in this issue.

Issue Links

• is related to: HDFS-4782 backport edit log corruption toleration to branch-1-win
• is related to: HDFS-3479 backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1
• is related to: HDFS-3521 Allow namenode to tolerate edit log corruption