Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3471

NullPointerException when NameNode is closing

    XMLWordPrintableJSON

    Details

    • Tags:
      namenode, NPE

      Description

      In local environment, there is NPE when NameNode is closing.
      +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
      2012-05-28 08:54:33,139 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 9000, call blockReceived(DatanodeRegistration(xx.xxx.xxx.xxx:50010, storageID=DS-1391415252-xx.xxx.xxx.xxx-50010-1330957852052, infoPort=50075, ipcPort=50020), [Lorg.apache.hadoop.hdfs.protocol.Block;@6639be68, [Ljava.lang.String;@5903d246) from xx.xxx.xxx.xxx:17022: error: java.io.IOException: java.lang.NullPointerException
      java.io.IOException: java.lang.NullPointerException
      at org.apache.hadoop.hdfs.server.namenode.BlocksMap.getStoredBlock(BlocksMap.java:408)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.addStoredBlock(FSNamesystem.java:3313)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.blockReceived(FSNamesystem.java:3870)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.blockReceived(NameNode.java:962)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)

      +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

      I tracked the source code. It may be caused by the FSNameSystem closed early than RPC server. The BlockMap instance is null for coming request from DN.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              dennyy Denny Ye
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: