Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3415

During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
    • Fix Version/s: 2.0.2-alpha
    • Component/s: namenode
    • Labels:
      None
    • Environment:

      Suse linux + jdk 1.6

      Description

      Scenario:
      =========
      start Namenode and datanode by configuring three storage dir's for namenode
      write 10 files
      edit version file of one of the storage dir and give layout version as 123 which different with default(-40).
      Stop namenode
      start Namenode.

      Then I am getting follwong exception...

      2012-05-13 19:01:41,483 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
      java.lang.NullPointerException
      	at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageFile(NNStorage.java:686)
      	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getEditsInStorageDir(FSImagePreTransactionalStorageInspector.java:243)
      	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getLatestEditsFiles(FSImagePreTransactionalStorageInspector.java:261)
      	at org.apache.hadoop.hdfs.server.namenode.FSImagePreTransactionalStorageInspector.getEditLogStreams(FSImagePreTransactionalStorageInspector.java:276)
      	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:596)
      	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:247)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:498)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:390)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:354)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:368)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:402)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:564)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:545)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1093)
      	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1151)
      2012-05-13 19:01:41,485 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: 
      
      

        Attachments

        1. HDFS-3415.patch
          4 kB
          Brandon Li
        2. HDFS-3415.patch
          4 kB
          Brandon Li
        3. HDFS-3415.patch
          3 kB
          Brandon Li
        4. HDFS-3415.patch
          2 kB
          Brandon Li

          Issue Links

            Activity

              People

              • Assignee:
                brandonli Brandon Li
                Reporter:
                brahmareddy Brahma Reddy Battula
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: