Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14934

[SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0, 3.1.4, 3.2.2, 2.10.1
    • None
    • None

    Description

      When dfs.ha.tail-edits.period is 0ms (or very short-time), there are many warn logs in standby NN.

      2019-10-25 16:25:46,945 [Logger channel (from parallel executor) to <nn hostname>/<ip address>:<port>] WARN  concurrent.ExecutorHelper (ExecutorHelper.java:logThrowableFromAfterExecute(55)) - Thread (Thread[Logger channel (from parallel executor) to <nn hostname>/<ip address>:<port>,5,main]) interrupted: 
      java.lang.InterruptedException
      	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:509)
      	at com.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:82)
      	at org.apache.hadoop.util.concurrent.ExecutorHelper.logThrowableFromAfterExecute(ExecutorHelper.java:48)
      	at org.apache.hadoop.util.concurrent.HadoopThreadPoolExecutor.afterExecute(HadoopThreadPoolExecutor.java:90)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      

      Attachments

        1. HDFS-14934-01.patch
          2 kB
          Ayush Saxena

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ayushtkn Ayush Saxena
            tasanuma Takanobu Asanuma
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment