[HDFS-3415] During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 2.0.2-alpha
• Component/s: namenode

Environment

Suse linux + jdk 1.6

• Target Version/s: 2.0.0-alpha
• Hadoop Flags: Reviewed
• Assignee: Brandon Li
• Reporter: Brahma Reddy Battula
• Created: 13/May/12 13:44
• Updated: 12/May/16 18:14
• Resolved: 22/May/12 23:20

Description

Scenario:
=========
start Namenode and datanode by configuring three storage dir's for namenode
write 10 files
edit version file of one of the storage dir and give layout version as 123 which different with default(-40).
Stop namenode
start Namenode.

Then I am getting follwong exception...

2012-05-13 19:01:41,483 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
java.lang.NullPointerException
	at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageFile(NNStorage.java:686)
	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getEditsInStorageDir(FSImagePreTransactionalStorageInspector.java:243)
	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getLatestEditsFiles(FSImagePreTransactionalStorageInspector.java:261)
	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getEditLogStreams(FSImagePreTransactionalStorageInspector.java:276)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:596)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:247)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:498)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:390)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:354)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:368)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:402)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:564)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:545)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1093)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1151)
2012-05-13 19:01:41,485 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: 

Issue Links

• relates to: HDFS-3629 fix the typo in the error message about inconsistent storage layout version