[HDFS-4782] backport edit log corruption toleration to branch-1-win

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1-win
• Fix Version/s: 1-win
• Component/s: namenode
• Target Version/s: 1-win
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 30/Apr/13 21:14
• Updated: 03/May/13 03:10
• Resolved: 03/May/13 01:11

Description

HDFS-3521 made changes to management of the edits log to prevent certain cases of corruption. This issue tracks backporting those changes to branch-1-win.

Issue Links

• relates to: HDFS-3540 Further improvement on recovery mode and edit log toleration in branch-1
• relates to: HDFS-3961 FSEditLog preallocate() needs to reset the position of PREALLOCATE_BUFFER when more than 1MB size is needed
• relates to: HDFS-4122 Cleanup HDFS logs and reduce the size of logged messages
• relates to: HDFS-4444 Add space between total transaction time and number of transactions in FSEditLog#printStatistics
• relates to: HDFS-3602 Enhancements to HDFS for Windows Server and Windows Azure development and runtime environments
• relates to: HDFS-3521 Allow namenode to tolerate edit log corruption
• relates to: HDFS-4252 Improve confusing log message that prints exception when editlog read is completed
• relates to: HDFS-3596 Improve FSEditLog pre-allocation in branch-1
• relates to: HDFS-3838 fix the typo in FSEditLog.java: isToterationEnabled should be isTolerationEnabled