Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Not A Problem
    • None
    • None
    • Admin
    • None

    Description

      HMaster went down

      /hbase/WALs/regionserver80-XXXXXXXXXXXsplitting is non empty': Directory is not empty

      Attachments

        Activity

          jamest86 James added a comment -

          2019-02-12 04:15:41,010 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 9000, call Call#154 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.delete from XXXXXXXX:49972
          org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: `/hbase/WALs/XXXXXXX-splitting is non empty': Directory is not empty
          at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115)
          at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2841)
          at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1065)
          at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:641)
          at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
          at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503)
          at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
          at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:868)
          at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:814)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:422)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1886)
          at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2603)
          2019-02-12  04:15:41,010 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 9000, call Call#161 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.delete from XXXXXXXXX:49972
          org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: `/hbase/WALs/XXXXXXXXXX-splitting is non empty': Directory is not empty
          at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115)
          at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2841)
          at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1065)
          at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:641)
          at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
          at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503)
          at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
          at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:868)
          at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:814)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:422)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1886)
          at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2603)

          jamest86 James added a comment - 2019-02-12 04:15:41,010 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 9000, call Call#154 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.delete from XXXXXXXX:49972 org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: `/hbase/WALs/XXXXXXX-splitting is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2841) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:641) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:868) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:814) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1886) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2603) 2019-02-12  04:15:41,010 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 9000, call Call#161 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.delete from XXXXXXXXX:49972 org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: `/hbase/WALs/XXXXXXXXXX-splitting is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2841) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:641) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:868) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:814) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1886) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2603)
          allan163 Allan Yang added a comment -

          This log is because of HBASE-21413. Which is not the reason of master went down. Jira is for filing issues, not for questions. Please send a email to user@hbase.apache.org with more info, so people can help you better. I will close this issue.

          allan163 Allan Yang added a comment - This log is because of HBASE-21413 . Which is not the reason of master went down. Jira is for filing issues, not for questions. Please send a email to user@hbase.apache.org with more info, so people can help you better. I will close this issue.

          People

            Unassigned Unassigned
            jamest86 James
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: