Uploaded image for project: 'Geode'
  1. Geode
  2. GEODE-10272

CI failure: SerialGatewaySenderEventProcessor throws RejectedExecutionException in handlePrimaryDestroy

    XMLWordPrintableJSON

Details

    Description

      https://hydradb.hdb.gemfire-ci.info/hdb/testresult/14917007

       

      > Task :geode-wan:distributedTest
      
      SerialWANPropagationOffHeapDUnitTest > testReplicatedSerialPropagationWithRemoteReceiverRestarted_SenderReceiverPersistent FAILED
          java.lang.AssertionError: Suspicious strings were written to the log during this run.
          Fix the strings or use IgnoredException.addIgnoredException to ignore.
          -----------------------------------------------------------------------
          Found suspect string in 'dunit_suspect-vm5.log' at line 578
      
          [error 2022/04/30 17:54:20.129 UTC <P2P message reader for heavy-lifter-85578c19-4fe0-5ec7-80ff-b9bbbad743e3(875001)<v1>:51004 unshared ordered sender uid=22 dom #1 local port=51185 remote port=59364> tid=172] Exception occurred in CacheListener
          java.util.concurrent.RejectedExecutionException: Task org.apache.geode.internal.cache.wan.serial.SerialGatewaySenderEventProcessor$$Lambda$419/1037103054@1aae2bfe rejected from java.util.concurrent.ThreadPoolExecutor@7d2e5a91[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 8478]
            at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
            at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830)
            at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379)
            at org.apache.geode.internal.cache.wan.serial.SerialGatewaySenderEventProcessor.handlePrimaryDestroy(SerialGatewaySenderEventProcessor.java:592)
            at org.apache.geode.internal.cache.wan.serial.SerialSecondaryGatewayListener.afterDestroy(SerialSecondaryGatewayListener.java:92)
            at org.apache.geode.internal.cache.EnumListenerEvent$AFTER_DESTROY.dispatchEvent(EnumListenerEvent.java:183)
            at org.apache.geode.internal.cache.LocalRegion.dispatchEvent(LocalRegion.java:8313)
            at org.apache.geode.internal.cache.LocalRegion.dispatchListenerEvent(LocalRegion.java:7021)
            at org.apache.geode.internal.cache.LocalRegion.invokeDestroyCallbacks(LocalRegion.java:6822)
            at org.apache.geode.internal.cache.EntryEventImpl.invokeCallbacks(EntryEventImpl.java:2454)
            at org.apache.geode.internal.cache.entries.AbstractRegionEntry.dispatchListenerEvents(AbstractRegionEntry.java:164)
            at org.apache.geode.internal.cache.LocalRegion.basicDestroyPart2(LocalRegion.java:6763)
            at org.apache.geode.internal.cache.map.RegionMapDestroy.destroyExistingEntry(RegionMapDestroy.java:420)
            at org.apache.geode.internal.cache.map.RegionMapDestroy.handleExistingRegionEntry(RegionMapDestroy.java:244)
            at org.apache.geode.internal.cache.map.RegionMapDestroy.destroy(RegionMapDestroy.java:152)
            at org.apache.geode.internal.cache.AbstractRegionMap.destroy(AbstractRegionMap.java:940)
            at org.apache.geode.internal.cache.LocalRegion.mapDestroy(LocalRegion.java:6552)
            at org.apache.geode.internal.cache.LocalRegion.mapDestroy(LocalRegion.java:6526)
            at org.apache.geode.internal.cache.LocalRegionDataView.destroyExistingEntry(LocalRegionDataView.java:59)
            at org.apache.geode.internal.cache.LocalRegion.basicDestroy(LocalRegion.java:6477)
            at org.apache.geode.internal.cache.DistributedRegion.basicDestroy(DistributedRegion.java:1745)
            at org.apache.geode.internal.cache.wan.serial.SerialGatewaySenderQueue$SerialGatewaySenderQueueMetaRegion.basicDestroy(SerialGatewaySenderQueue.java:1372)
            at org.apache.geode.internal.cache.LocalRegion.localDestroy(LocalRegion.java:2261)
            at org.apache.geode.internal.cache.DistributedRegion.localDestroy(DistributedRegion.java:981)
            at org.apache.geode.internal.cache.wan.serial.BatchDestroyOperation$DestroyMessage.operateOnRegion(BatchDestroyOperation.java:121)
            at org.apache.geode.internal.cache.DistributedCacheOperation$CacheOperationMessage.basicProcess(DistributedCacheOperation.java:1196)
            at org.apache.geode.internal.cache.DistributedCacheOperation$CacheOperationMessage.process(DistributedCacheOperation.java:1102)
            at org.apache.geode.distributed.internal.DistributionMessage.scheduleAction(DistributionMessage.java:380)
            at org.apache.geode.distributed.internal.DistributionMessage.schedule(DistributionMessage.java:436)
            at org.apache.geode.distributed.internal.ClusterDistributionManager.scheduleIncomingMessage(ClusterDistributionManager.java:2080)
            at org.apache.geode.distributed.internal.ClusterDistributionManager.handleIncomingDMsg(ClusterDistributionManager.java:1844)
            at org.apache.geode.distributed.internal.membership.gms.GMSMembership.dispatchMessage(GMSMembership.java:850)
            at org.apache.geode.distributed.internal.membership.gms.GMSMembership.handleOrDeferMessage(GMSMembership.java:807)
            at org.apache.geode.distributed.internal.membership.gms.GMSMembership.processMessage(GMSMembership.java:1105)
            at org.apache.geode.distributed.internal.DistributionImpl$MyDCReceiver.messageReceived(DistributionImpl.java:838)
            at org.apache.geode.distributed.internal.direct.DirectChannel.receive(DirectChannel.java:620)
            at org.apache.geode.internal.tcp.TCPConduit.messageReceived(TCPConduit.java:682)
            at org.apache.geode.internal.tcp.Connection.dispatchMessage(Connection.java:3329)
            at org.apache.geode.internal.tcp.Connection.readMessage(Connection.java:3070)
            at org.apache.geode.internal.tcp.Connection.processInputBuffer(Connection.java:2849)
            at org.apache.geode.internal.tcp.Connection.readMessages(Connection.java:1660)
            at org.apache.geode.internal.tcp.Connection.run(Connection.java:1500)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:750)
              at org.junit.Assert.fail(Assert.java:89)
              at org.apache.geode.test.dunit.internal.DUnitLauncher.closeAndCheckForSuspects(DUnitLauncher.java:422)
              at org.apache.geode.test.dunit.internal.DUnitLauncher.closeAndCheckForSuspects(DUnitLauncher.java:438)
              at org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.cleanupAllVms(JUnit4DistributedTestCase.java:552)
              at org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.doTearDownDistributedTestCase(JUnit4DistributedTestCase.java:499)
              at org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.tearDownDistributedTestCase(JUnit4DistributedTestCase.java:482)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
              at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
              at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
              at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46)
              at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
              at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
              at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
              at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
              at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
              at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
              at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
              at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
              at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
              at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
              at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
              at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
              at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
              at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
              at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
              at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
              at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
              at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42)
              at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80)
              at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72)
              at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:108)
              at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)
              at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)
              at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)
              at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)
              at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:96)
              at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:75)
              at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.processAllTestClasses(JUnitPlatformTestClassProcessor.java:99)
              at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.access$000(JUnitPlatformTestClassProcessor.java:79)
              at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor.stop(JUnitPlatformTestClassProcessor.java:75)
              at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.stop(SuiteTestClassProcessor.java:61)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
              at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
              at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
              at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
              at com.sun.proxy.$Proxy2.stop(Unknown Source)
              at org.gradle.api.internal.tasks.testing.worker.TestWorker.stop(TestWorker.java:133)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
              at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
              at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
              at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
              at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
              at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
              at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
              at java.lang.Thread.run(Thread.java:750)
      
      1042 tests completed, 1 failed, 59 skipped
      
      =-=-=-=-=-=-=-=-=-=-=-=-=-=-=  Test Results URI =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      http://files.apachegeode-ci.info/builds/apache-develop-mass-test-run/1.15.0-build.1130/test-results/distributedTest/1651345534/
      =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      
      Test report artifacts from this job are available at:
      
      http://files.apachegeode-ci.info/builds/apache-develop-mass-test-run/1.15.0-build.1130/test-artifacts/1651345534/distributedtestfiles-openjdk8-1.15.0-build.1130.tgz

      Attachments

        Issue Links

          Activity

            People

              eshu Eric Shu
              burcham Bill Burcham
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: