Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-32189 Integration tests fail due to Process Exit Code: 239 and NoClassDefFound in logs
  3. FLINK-30140

flink-runtime intergration tests fail due to Process Exit Code: 239 (because of NoClassDefFoundError akka.remote.transport.netty.NettyFutureBridge$$anon$1)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 1.16.0, 1.17.0
    • None
    • Runtime / Coordination

    Description

      This build failed with a 239 exit code in flink-runtime without any specific test being revealed:

      Nov 14 11:40:46 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (default-test) on project flink-runtime: There are test failures.
Nov 14 11:40:46 [ERROR] 
Nov 14 11:40:46 [ERROR] Please refer to /__w/2/s/flink-runtime/target/surefire-reports for the individual test results.
Nov 14 11:40:46 [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
Nov 14 11:40:46 [ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
Nov 14 11:40:46 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -XX:+UseG1GC -Xms256m -Xmx768m -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter1852368249697011408.jar /__w/2/s/flink-runtime/target/surefire 2022-11-14T11-36-53_855-jvmRun4 surefire376251412927954214tmp surefire_22793960051744290914tmp
Nov 14 11:40:46 [ERROR] Error occurred in starting fork, check output in log
Nov 14 11:40:46 [ERROR] Process Exit Code: 239
Nov 14 11:40:46 [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
Nov 14 11:40:46 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -XX:+UseG1GC -Xms256m -Xmx768m -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter1852368249697011408.jar /__w/2/s/flink-runtime/target/surefire 2022-11-14T11-36-53_855-jvmRun4 surefire376251412927954214tmp surefire_22793960051744290914tmp
Nov 14 11:40:46 [ERROR] Error occurred in starting fork, check output in log
Nov 14 11:40:46 [ERROR] Process Exit Code: 239
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:532)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkOnceMultiple(ForkStarter.java:405)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:321)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:266)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1314)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1159)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:932)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
Nov 14 11:40:46 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
Nov 14 11:40:46 [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
Nov 14 11:40:46 [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
Nov 14 11:40:46 [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
Nov 14 11:40:46 [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
Nov 14 11:40:46 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
Nov 14 11:40:46 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Nov 14 11:40:46 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Nov 14 11:40:46 [ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 14 11:40:46 [ERROR] at java.lang.reflect.Method.invoke(Method.java:498)
Nov 14 11:40:46 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
Nov 14 11:40:46 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
Nov 14 11:40:46 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
Nov 14 11:40:46 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Nov 14 11:40:46 [ERROR] Caused by: org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
Nov 14 11:40:46 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -XX:+UseG1GC -Xms256m -Xmx768m -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter1852368249697011408.jar /__w/2/s/flink-runtime/target/surefire 2022-11-14T11-36-53_855-jvmRun4 surefire376251412927954214tmp surefire_22793960051744290914tmp
Nov 14 11:40:46 [ERROR] Error occurred in starting fork, check output in log
Nov 14 11:40:46 [ERROR] Process Exit Code: 239
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:748)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$700(ForkStarter.java:121)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:393)
Nov 14 11:40:46 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:370)
Nov 14 11:40:46 [ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
Nov 14 11:40:46 [ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
Nov 14 11:40:46 [ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
Nov 14 11:40:46 [ERROR] at java.lang.Thread.run(Thread.java:748)
Nov 14 11:40:46 [ERROR] -> [Help 1]
Nov 14 11:40:46 [ERROR] 
Nov 14 11:40:46 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
Nov 14 11:40:46 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
Nov 14 11:40:46 [ERROR] 
Nov 14 11:40:46 [ERROR] For more information about the errors and possible solutions, please read the following articles:
Nov 14 11:40:46 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Nov 14 11:40:47 Process exited with EXIT CODE: 1

       The corresponding build logs do not reveal anything. I attached the logs

      UPD: in logs there is

      01:51:05,743 [flink-akka.remote.default-remote-dispatcher-14] ERROR org.apache.flink.util.FatalExitExceptionHandler              [] - FATAL: Thread 'flink-akka.remote.default-remote-dispatcher-14' produced an uncaught exception. Stopping 
the process...
java.lang.NoClassDefFoundError: akka/remote/transport/netty/NettyFutureBridge$$anon$1
        at akka.remote.transport.netty.NettyFutureBridge$.apply(NettyTransport.scala:65) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.remote.transport.netty.NettyTransport.$anonfun$associate$1(NettyTransport.scala:566) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:303) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:37) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49) ~[flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48) [flink-rpc-akka_08034fee-ff0a-42c1-98f7-a4be5fc3db63.jar:1.16-SNAPSHOT]
        at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292]
        at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292]
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292]
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292]
Caused by: java.lang.ClassNotFoundException: akka.remote.transport.netty.NettyFutureBridge$$anon$1
        at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_292]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_292]
        at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:149) ~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
        at org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:112) ~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_292]
        ... 16 more

      also thread dump

      01:51:05,830 [flink-akka.remote.default-remote-dispatcher-14] ERROR org.apache.flink.util.FatalExitExceptionHandler              [] - Thread dump: 
"flink-akka.actor.internal-dispatcher-24" Id=1143 RUNNABLE
        at java.util.concurrent.ForkJoinPool$WorkQueue.growArray(ForkJoinPool.java:886)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1687)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.remote.default-remote-dispatcher-23" Id=1141 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.remote.default-remote-dispatcher-22" Id=1140 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.remote.default-remote-dispatcher-21" Id=1139 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.remote.default-remote-dispatcher-20" Id=1138 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.actor.default-dispatcher-16" Id=1130 RUNNABLE
        at java.net.URLClassLoader.close(URLClassLoader.java:297)
        -  locked java.util.WeakHashMap@12cb0ba1
        at org.apache.flink.runtime.rpc.akka.CleanupOnCloseRpcSystem.close(CleanupOnCloseRpcSystem.java:56)
        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner$$Lambda$2657/1030695720.run(Unknown Source)
        at org.apache.flink.util.concurrent.FutureUtils.lambda$runAfterwardsAsync$15(FutureUtils.java:594)
        at org.apache.flink.util.concurrent.FutureUtils$$Lambda$806/1864236240.accept(Unknown Source)
        at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
        at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
        at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
        ...

"Flink Netty Client (0) Thread 0" Id=1129 TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:787)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:402)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
        at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at java.lang.Thread.run(Thread.java:748)

"Flink Netty Server (0) Thread 0" Id=1125 TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:787)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:402)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
        at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at java.lang.Thread.run(Thread.java:748)

"flink-akka.remote.default-remote-dispatcher-14" Id=1090 RUNNABLE
        at sun.management.ThreadImpl.dumpThreads0(Native Method)
        at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:496)
        at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:484)
        at org.apache.flink.util.concurrent.ThreadUtils.errorLogThreadDump(ThreadUtils.java:33)
        at org.apache.flink.util.FatalExitExceptionHandler.uncaughtException(FatalExitExceptionHandler.java:47)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:57)
        at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
        at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
        ...

"flink-akka.remote.default-remote-dispatcher-6" Id=1082 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.remote.default-remote-dispatcher-5" Id=1081 WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@58f74e6a
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"flink-akka.actor.default-dispatcher-4" Id=1080 TIMED_WAITING on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@53883352
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool@53883352
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"Time-limited test" Id=1074 WAITING on java.util.concurrent.CompletableFuture$Signaller@31eea357
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.CompletableFuture$Signaller@31eea357
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
        at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
        at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.close(TaskManagerRunner.java:295)
        at org.apache.flink.runtime.taskexecutor.TaskManagerRunnerTest.testWorkingDirIsSetupWhenStartingTaskManagerRunner(TaskManagerRunnerTest.java:226)
        ...

"ForkJoinPool.commonPool-worker-22" Id=1060 WAITING on java.util.concurrent.ForkJoinPool@7bb220c8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.ForkJoinPool@7bb220c8
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"IOManager reader thread #1" Id=564 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2244da23
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2244da23
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.flink.runtime.io.disk.iomanager.IOManagerAsync$ReaderThread.run(IOManagerAsync.java:372)

"IOManager writer thread #1" Id=563 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30446f9a
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30446f9a
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.flink.runtime.io.disk.iomanager.IOManagerAsync$WriterThread.run(IOManagerAsync.java:482)

"pool-249-thread-1" Id=538 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@747486de
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@747486de
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"ForkJoinPool.commonPool-worker-29" Id=439 WAITING on java.util.concurrent.ForkJoinPool@7bb220c8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.ForkJoinPool@7bb220c8
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"ForkJoinPool.commonPool-worker-4" Id=438 WAITING on java.util.concurrent.ForkJoinPool@7bb220c8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.ForkJoinPool@7bb220c8
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"ForkJoinPool.commonPool-worker-11" Id=437 WAITING on java.util.concurrent.ForkJoinPool@7bb220c8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.ForkJoinPool@7bb220c8
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"Flink Netty Server (0) Thread 0" Id=243 RUNNABLE (in native)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native Method)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native.java:193)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native.java:186)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
        at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at java.lang.Thread.run(Thread.java:748)

"Flink Netty Server (0) Thread 0" Id=242 RUNNABLE (in native)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native Method)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native.java:193)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.Native.epollWait(Native.java:186)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
        at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
        at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at java.lang.Thread.run(Thread.java:748)

"ForkJoinPool.commonPool-worker-18" Id=117 WAITING on java.util.concurrent.ForkJoinPool@7bb220c8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.ForkJoinPool@7bb220c8
        at java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)

"ForkJoinPool.commonPool-worker-25" Id=45 WAITING on java.lang.Object@79c876e1
        at java.lang.Object.wait(Native Method)
        -  waiting on java.lang.Object@79c876e1
        at java.lang.Object.wait(Object.java:502)
        at org.apache.flink.core.testutils.OneShotLatch.await(OneShotLatch.java:61)
        at org.apache.flink.runtime.dispatcher.cleanup.CheckpointResourcesCleanupRunnerTest$HaltingCheckpointRecoveryFactory.createRecoveredCompletedCheckpointStore(CheckpointResourcesCleanupRunnerTest.java:629)
        at org.apache.flink.runtime.dispatcher.cleanup.CheckpointResourcesCleanupRunner.createCompletedCheckpointStore(CheckpointResourcesCleanupRunner.java:144)
        at org.apache.flink.runtime.dispatcher.cleanup.CheckpointResourcesCleanupRunner.cleanupCheckpoints(CheckpointResourcesCleanupRunner.java:122)
        at org.apache.flink.runtime.dispatcher.cleanup.CheckpointResourcesCleanupRunner.lambda$runCleanupAsync$1(CheckpointResourcesCleanupRunner.java:101)
        at org.apache.flink.runtime.dispatcher.cleanup.CheckpointResourcesCleanupRunner$$Lambda$1087/627029889.run(Unknown Source)
        ...

"FlinkCompletableFutureDelayScheduler-thread-1" Id=31 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e2a4cf8
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e2a4cf8
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ...

"Attach Listener" Id=29 RUNNABLE

"surefire-forkedjvm-command-thread" Id=25 WAITING on java.util.concurrent.CountDownLatch$Sync@5982a934
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.CountDownLatch$Sync@5982a934
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
        at sun.nio.ch.PendingFuture.get(PendingFuture.java:180)
        at org.apache.maven.surefire.api.util.internal.Channels$2.read(Channels.java:157)
        -  locked org.apache.maven.surefire.api.util.internal.Channels$2@1abb18dc
        ...

"pool-1-thread-2" Id=23 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@15836370
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@15836370
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
        at sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:262)
        at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ...

        Number of locked synchronizers = 1
        - java.util.concurrent.ThreadPoolExecutor$Worker@2aafb23c

"pool-1-thread-1" Id=22 RUNNABLE (in native)
        at sun.nio.ch.EPoll.epollWait(Native Method)
        at sun.nio.ch.EPollPort$EventHandlerTask.poll(EPollPort.java:194)
        at sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:268)
        at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

        Number of locked synchronizers = 1
        - java.util.concurrent.ThreadPoolExecutor$Worker@34340fab

"Signal Dispatcher" Id=5 RUNNABLE

"Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@573ce4e4
        at java.lang.Object.wait(Native Method)
        -  waiting on java.lang.ref.ReferenceQueue$Lock@573ce4e4
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)

"Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@67fbc138
        at java.lang.Object.wait(Native Method)
        -  waiting on java.lang.ref.Reference$Lock@67fbc138
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"main" Id=1 TIMED_WAITING on java.util.concurrent.FutureTask@5ac46741
        at sun.misc.Unsafe.park(Native Method)
        -  waiting on java.util.concurrent.FutureTask@5ac46741
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:426)
        at java.util.concurrent.FutureTask.get(FutureTask.java:204)
        at org.junit.internal.runners.statements.FailOnTimeout.getResult(FailOnTimeout.java:167)
        at org.junit.internal.runners.statements.FailOnTimeout.evaluate(FailOnTimeout.java:128)
        at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
        at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
        ...

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue FLINK-30299 TaskManagerRunnerTest fails with 239 exit code (i.e. FatalExitExceptionHandler was called) NoClassDefFoundError: akka/remote/transport/netty/NettyFutureBridge$$anon$1

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Sub-task - The sub-task of the issue FLINK-32095 HiveDialectITCase crashed with exit code 239

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              mapohl Matthias Pohl
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: