Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-693

Too Many "Problem Renewing Lease" Messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None

    Description

      I restarted Hadoop and reloaded my Accumulo monitor page. Then the exception below starting appearing in my tserver log - a lot. Does it make sense to try three times with increasing pauses between the attempts? Should the web page timeout an display an error message?

      15 02:14:32,694 [hdfs.DFSClient] WARN : Problem renewing lease for DFSClient_134996827
      org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_134996827. Name node is in safe mode.
      The ratio of reported blocks 0.8750 has not reached the threshold 0.9990. Safe mode will be turned off automatically.
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:1978)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.renewLease(NameNode.java:550)
      at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)

      at org.apache.hadoop.ipc.Client.call(Client.java:740)
      at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
      at $Proxy0.renewLease(Unknown Source)
      at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
      at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
      at $Proxy0.renewLease(Unknown Source)
      at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.renew(DFSClient.java:1057)
      at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1069)
      at java.lang.Thread.run(Thread.java:722)

      Attachments

        Activity

          People

            Unassigned Unassigned
            medined David Medinets
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: