[FLINK-24792] OperatorCoordinatorSchedulerTest crashed JVM on AZP

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.14.0, 1.15.0
• Fix Version/s: 1.14.3, 1.15.0
• Component/s: Runtime / Coordination
• Labels: test-stability
• Assignee: Unassigned
• Reporter: Till Rohrmann
• Created: 05/Nov/21 10:39
• Updated: 07/Apr/22 07:55
• Resolved: 05/Nov/21 11:52

Description

The OperatorCoordinatorSchedulerTest crashed the JVM on AZP:

2021-11-04T23:04:42.9147131Z Nov 04 23:04:42 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on project flink-runtime: There are test failures.
2021-11-04T23:04:42.9148019Z Nov 04 23:04:42 [ERROR] 
2021-11-04T23:04:42.9149110Z Nov 04 23:04:42 [ERROR] Please refer to /__w/2/s/flink-runtime/target/surefire-reports for the individual test results.
2021-11-04T23:04:42.9149931Z Nov 04 23:04:42 [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
2021-11-04T23:04:42.9150465Z Nov 04 23:04:42 [ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
2021-11-04T23:04:42.9152168Z Nov 04 23:04:42 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=1 -XX:+UseG1GC -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter6689593993396607766.jar /__w/2/s/flink-runtime/target/surefire 2021-11-04T22-41-25_783-jvmRun1 surefire1850634831631421222tmp surefire_4465457992371306280265tmp
2021-11-04T23:04:42.9153058Z Nov 04 23:04:42 [ERROR] Error occurred in starting fork, check output in log
2021-11-04T23:04:42.9153527Z Nov 04 23:04:42 [ERROR] Process Exit Code: 239
2021-11-04T23:04:42.9153989Z Nov 04 23:04:42 [ERROR] Crashed tests:
2021-11-04T23:04:42.9154899Z Nov 04 23:04:42 [ERROR] org.apache.flink.runtime.operators.coordination.OperatorCoordinatorSchedulerTest
2021-11-04T23:04:42.9155833Z Nov 04 23:04:42 [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
2021-11-04T23:04:42.9164535Z Nov 04 23:04:42 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=1 -XX:+UseG1GC -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter6689593993396607766.jar /__w/2/s/flink-runtime/target/surefire 2021-11-04T22-41-25_783-jvmRun1 surefire1850634831631421222tmp surefire_4465457992371306280265tmp
2021-11-04T23:04:42.9165558Z Nov 04 23:04:42 [ERROR] Error occurred in starting fork, check output in log
2021-11-04T23:04:42.9165928Z Nov 04 23:04:42 [ERROR] Process Exit Code: 239
2021-11-04T23:04:42.9166270Z Nov 04 23:04:42 [ERROR] Crashed tests:
2021-11-04T23:04:42.9166760Z Nov 04 23:04:42 [ERROR] org.apache.flink.runtime.operators.coordination.OperatorCoordinatorSchedulerTest
2021-11-04T23:04:42.9167319Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
2021-11-04T23:04:42.9167954Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
2021-11-04T23:04:42.9168865Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
2021-11-04T23:04:42.9169721Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
2021-11-04T23:04:42.9170555Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
2021-11-04T23:04:42.9171215Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
2021-11-04T23:04:42.9172268Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
2021-11-04T23:04:42.9172889Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
2021-11-04T23:04:42.9173460Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
2021-11-04T23:04:42.9174087Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
2021-11-04T23:04:42.9174961Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
2021-11-04T23:04:42.9175904Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
2021-11-04T23:04:42.9177000Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
2021-11-04T23:04:42.9178084Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
2021-11-04T23:04:42.9179108Z Nov 04 23:04:42 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
2021-11-04T23:04:42.9179908Z Nov 04 23:04:42 [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
2021-11-04T23:04:42.9180499Z Nov 04 23:04:42 [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
2021-11-04T23:04:42.9181049Z Nov 04 23:04:42 [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
2021-11-04T23:04:42.9181510Z Nov 04 23:04:42 [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
2021-11-04T23:04:42.9182261Z Nov 04 23:04:42 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
2021-11-04T23:04:42.9182972Z Nov 04 23:04:42 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-11-04T23:04:42.9183946Z Nov 04 23:04:42 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-11-04T23:04:42.9184557Z Nov 04 23:04:42 [ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-11-04T23:04:42.9185068Z Nov 04 23:04:42 [ERROR] at java.lang.reflect.Method.invoke(Method.java:498)
2021-11-04T23:04:42.9185769Z Nov 04 23:04:42 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
2021-11-04T23:04:42.9186751Z Nov 04 23:04:42 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
2021-11-04T23:04:42.9187652Z Nov 04 23:04:42 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
2021-11-04T23:04:42.9188466Z Nov 04 23:04:42 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
2021-11-04T23:04:42.9189538Z Nov 04 23:04:42 [ERROR] Caused by: org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
2021-11-04T23:04:42.9192027Z Nov 04 23:04:42 [ERROR] Command was /bin/sh -c cd /__w/2/s/flink-runtime && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=1 -XX:+UseG1GC -jar /__w/2/s/flink-runtime/target/surefire/surefirebooter6689593993396607766.jar /__w/2/s/flink-runtime/target/surefire 2021-11-04T22-41-25_783-jvmRun1 surefire1850634831631421222tmp surefire_4465457992371306280265tmp
2021-11-04T23:04:42.9193005Z Nov 04 23:04:42 [ERROR] Error occurred in starting fork, check output in log
2021-11-04T23:04:42.9193581Z Nov 04 23:04:42 [ERROR] Process Exit Code: 239
2021-11-04T23:04:42.9194088Z Nov 04 23:04:42 [ERROR] Crashed tests:
2021-11-04T23:04:42.9194703Z Nov 04 23:04:42 [ERROR] org.apache.flink.runtime.operators.coordination.OperatorCoordinatorSchedulerTest
2021-11-04T23:04:42.9195364Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:669)
2021-11-04T23:04:42.9196498Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:115)
2021-11-04T23:04:42.9197532Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:444)
2021-11-04T23:04:42.9198386Z Nov 04 23:04:42 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:420)
2021-11-04T23:04:42.9199240Z Nov 04 23:04:42 [ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2021-11-04T23:04:42.9200052Z Nov 04 23:04:42 [ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2021-11-04T23:04:42.9200875Z Nov 04 23:04:42 [ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2021-11-04T23:04:42.9201552Z Nov 04 23:04:42 [ERROR] at java.lang.Thread.run(Thread.java:748)
2021-11-04T23:04:42.9202414Z Nov 04 23:04:42 [ERROR] -> [Help 1]
2021-11-04T23:04:42.9202681Z Nov 04 23:04:42 [ERROR] 

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25983&view=logs&j=0e7be18f-84f2-53f0-a32d-4a5e4a174679&t=7c1d86e3-35bd-5fd5-3b7c-30c126a78702&l=7728

Issue Links

• duplicates: FLINK-24789 IllegalStateException with CheckpointCleaner being closed already