[HADOOP-1188] processIOError() should update fstime file

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.10.1, 0.11.2, 0.12.2
• Fix Version/s: 0.16.1
• Assignee: Konstantin Shvachko
• Reporter: Konstantin Shvachko
• Created: 30/Mar/07 22:51
• Updated: 08/Jul/09 16:42
• Resolved: 06/Feb/08 00:13

Description

Name-node can have multiple directories to store the name space image and edits.
During startup the name-node selects the latest image and reads it in memory.
fstime stores the time of the latest checkpoint.
If one of the directories becomes inaccessible during normal operation the name-node
excludes it from the list, and never writes anything into it until restarted.
Now if the the name-node restarts after excluding one of the directories, and if that
excluded directory contained the latest image, then all modifications of the name space
recorded in edits files in other directories starting from the moment the directory was
excluded will be lost.
We should update fstime in all remaining good directories after the exclusion.

Issue Links

• is related to: HDFS-87 NameNode startup fails if edit log terminates prematurely
• relates to: HADOOP-4045 Increment checkpoint if we see failures in rollEdits