Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3063

MutableIndexFailureIT is getting hanged in 4.x-HBase-0.98 branch

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 4.8.0
    • 4.8.0
    • None
    • None

    Description

      Jstack dump

      main" prio=10 tid=0x00007f4aa4009000 nid=0x2ab5 waiting on condition [0x00007f4aabdac000]
         java.lang.Thread.State: TIMED_WAITING (sleeping)
      	at java.lang.Thread.sleep(Native Method)
      	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:149)
      	- locked <0x00000007e63abea0> (a org.apache.hadoop.hbase.client.RpcRetryingCaller)
      	at org.apache.hadoop.hbase.client.HTable.getRowOrBefore(HTable.java:749)
      	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:144)
      	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1261)
      	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1323)
      	- locked <0x00000007faa66dd8> (a java.lang.Object)
      	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1179)
      	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1136)
      	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:977)
      	at org.apache.hadoop.hbase.client.RegionServerCallable.prepare(RegionServerCallable.java:74)
      	at org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:125)
      	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:114)
      	- locked <0x00000007fab4f3f8> (a org.apache.hadoop.hbase.client.RpcRetryingCaller)
      	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:91)
      	- locked <0x00000007fab4f3f8> (a org.apache.hadoop.hbase.client.RpcRetryingCaller)
      	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:289)
      	at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:190)
      	at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:185)
      	at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:111)
      	at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:780)
      	at org.apache.phoenix.schema.stats.StatisticsUtil.readStatistics(StatisticsUtil.java:139)
      	at org.apache.phoenix.query.TableStatsCache$StatsLoader.load(TableStatsCache.java:93)
      	at org.apache.phoenix.query.TableStatsCache$StatsLoader.load(TableStatsCache.java:84)
      	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3589)
      	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2374)
      	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2337)
      	- locked <0x00000007fab4f648> (a com.google.common.cache.LocalCache$StrongAccessWriteEntry)
      	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2252)
      	at com.google.common.cache.LocalCache.get(LocalCache.java:3990)
      	at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3994)
      	at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4878)
      	at org.apache.phoenix.query.TableStatsCache.get(TableStatsCache.java:140)
      	at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTableStats(ConnectionQueryServicesImpl.java:3353)
      	at org.apache.phoenix.iterate.BaseResultIterators.<init>(BaseResultIterators.java:362)
      	at org.apache.phoenix.iterate.ParallelIterators.<init>(ParallelIterators.java:60)
      	at org.apache.phoenix.iterate.ParallelIterators.<init>(ParallelIterators.java:67)
      	at org.apache.phoenix.execute.AggregatePlan.newIterator(AggregatePlan.java:215)
      	at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:320)
      	at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:216)
      	at org.apache.phoenix.compile.PostDDLCompiler$2.execute(PostDDLCompiler.java:283)
      	at org.apache.phoenix.query.ConnectionQueryServicesImpl.updateData(ConnectionQueryServicesImpl.java:2805)
      	at org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:939)
      	at org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:194)
      	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:340)
      	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:328)
      	at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
      	at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:326)
      	at org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:1369)
      	at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2349)
      	- locked <0x00000007fab4f740> (a org.apache.phoenix.end2end.ConnectionQueryServicesTestImpl)
      	at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2296)
      	at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:78)
      	at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2296)
      	at org.apache.phoenix.end2end.ConnectionQueryServicesTestImpl.init(ConnectionQueryServicesTestImpl.java:64)
      	at org.apache.phoenix.jdbc.PhoenixTestDriver.getConnectionQueryServices(PhoenixTestDriver.java:96)
      	- locked <0x00000007fab769b8> (a org.apache.phoenix.jdbc.PhoenixTestDriver)
      	at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:142)
      	at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.connect(PhoenixEmbeddedDriver.java:136)
      	at org.apache.phoenix.jdbc.PhoenixTestDriver.connect(PhoenixTestDriver.java:83)
      	- locked <0x00000007fab769b8> (a org.apache.phoenix.jdbc.PhoenixTestDriver)
      	at org.apache.phoenix.query.BaseTest.initAndRegisterTestDriver(BaseTest.java:770)
      
      
      	at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:630)
      	at org.apache.phoenix.end2end.index.MutableIndexFailureIT.doSetup(MutableIndexFailureIT.java:115)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.junit.runners.Suite.runChild(Suite.java:128)
      	at org.junit.runners.Suite.runChild(Suite.java:27)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
      	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
      	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
      	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
      	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
      	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
      

      Attachments

        1. PHOENIX-3063.patch
          12 kB
          Ankit Singhal

        Activity

          People

            ankit@apache.org Ankit Singhal
            ankit@apache.org Ankit Singhal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: