Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6021

NPE in FSImageFormatProtobuf upgrading from layout -52 to -53

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      While updating my trunk instance the namenode refused to startup because the layout version needed to be upgraded. When attempting the upgrade ran into an NPE in FSImageFormatProtobuf. Full stacktrace to follow.

        Issue Links

          Activity

          Hide
          Jason Lowe added a comment -

          Resolving as a dup of HDFS-5988 since that seems like the most likely culprit. I'll reopen if it occurs again. Thanks Andrew!

          Show
          Jason Lowe added a comment - Resolving as a dup of HDFS-5988 since that seems like the most likely culprit. I'll reopen if it occurs again. Thanks Andrew!
          Hide
          Andrew Wang added a comment -

          I believe since the merge of the PB fsimage code. Sorry if that was unclear in HDFS-5988.

          Show
          Andrew Wang added a comment - I believe since the merge of the PB fsimage code. Sorry if that was unclear in HDFS-5988 .
          Hide
          Jason Lowe added a comment -

          Seems likely. I've been upgrading all along on my trunk instance and have not received failures like this until recently. HDFS-5988 doesn't mention what change broke the upgrade process. In other words, do we know what window of time upgrades were broken?

          Show
          Jason Lowe added a comment - Seems likely. I've been upgrading all along on my trunk instance and have not received failures like this until recently. HDFS-5988 doesn't mention what change broke the upgrade process. In other words, do we know what window of time upgrades were broken?
          Hide
          Andrew Wang added a comment -

          Hi Jason, is this HDFS-5988? Might be good to try an upgrade from a known-good release to trunk to test.

          Show
          Andrew Wang added a comment - Hi Jason, is this HDFS-5988 ? Might be good to try an upgrade from a known-good release to trunk to test.
          Hide
          Jason Lowe added a comment -

          Stacktrace:

          2014-02-26 17:03:11,755 FATAL [main] namenode.NameNode (NameNode.java:main(1351)) - Exception in namenode join
          java.lang.NullPointerException
          	at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.loadInternal(FSImageFormatProtobuf.java:227)
          	at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.load(FSImageFormatProtobuf.java:169)
          	at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:225)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:802)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:792)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:624)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:593)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:331)
          	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:251)
          	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:882)
          	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:641)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:435)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:647)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:632)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1280)
          	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1346)
          
          Show
          Jason Lowe added a comment - Stacktrace: 2014-02-26 17:03:11,755 FATAL [main] namenode.NameNode (NameNode.java:main(1351)) - Exception in namenode join java.lang.NullPointerException at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.loadInternal(FSImageFormatProtobuf.java:227) at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.load(FSImageFormatProtobuf.java:169) at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:225) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:802) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:792) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:624) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:593) at org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:331) at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:251) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:882) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:641) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:435) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:647) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:632) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1280) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1346)

            People

            • Assignee:
              Unassigned
              Reporter:
              Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development