Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14812

Fix ResultBoundedCompletionService deadlock

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.0, 1.3.0, 1.1.4, 2.0.0
    • Component/s: Client, Thrift
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      "thrift2-worker-0" #31 daemon prio=5 os_prio=0 tid=0x00007f5ad9c45000 nid=0x484 in Object.wait() [0x00007f5aa3832000]
         java.lang.Thread.State: WAITING (on object monitor)
              at java.lang.Object.wait(Native Method)
              at java.lang.Object.wait(Object.java:502)
              at org.apache.hadoop.hbase.client.ResultBoundedCompletionService.take(ResultBoundedCompletionService.java:148)
              - locked <0x00000006b6ae7670> (a [Lorg.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture;)
              at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:188)
              at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:59)
              at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
              at org.apache.hadoop.hbase.client.ClientSmallReversedScanner.loadCache(ClientSmallReversedScanner.java:212)
              at org.apache.hadoop.hbase.client.ClientSmallReversedScanner.next(ClientSmallReversedScanner.java:186)
              at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1276)
              at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1182)
              at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
              at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
              at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:194)
              at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:171)
              - locked <0x00000006b6ae79c0> (a org.apache.hadoop.hbase.client.BufferedMutatorImpl)
              at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1430)
              at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1033)
              at org.apache.hadoop.hbase.thrift2.ThriftHBaseServiceHandler.putMultiple(ThriftHBaseServiceHandler.java:268)
              at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:497)
              at org.apache.hadoop.hbase.thrift2.ThriftHBaseServiceHandler$THBaseServiceMetricsProxy.invoke(ThriftHBaseServiceHandler.java:114)
              at com.sun.proxy.$Proxy10.putMultiple(Unknown Source)
              at org.apache.hadoop.hbase.thrift2.generated.THBaseService$Processor$putMultiple.getResult(THBaseService.java:1637)
              at org.apache.hadoop.hbase.thrift2.generated.THBaseService$Processor$putMultiple.getResult(THBaseService.java:1621)
              at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
              at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
              at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:478)
              at org.apache.thrift.server.Invocation.run(Invocation.java:18)
              at org.apache.hadoop.hbase.thrift.CallQueue$Call.run(CallQueue.java:64)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
              at java.lang.Thread.run(Thread.java:745)
      
      

        Attachments

        1. HBASE-14812.patch
          5 kB
          Elliott Neil Clark
        2. HBASE-14812-v1.patch
          6 kB
          Elliott Neil Clark
        3. HBASE-14812-v2.patch
          7 kB
          Elliott Neil Clark

        Issue Links

          Activity

            People

            • Assignee:
              eclark Elliott Neil Clark
              Reporter:
              eclark Elliott Neil Clark

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment