[AMBARI-21964] branch-2.6 Builds Fail With Forked VM Error On Tests

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.6.0
• Assignee: Andrew Onischuk
• Reporter: Andrew Onischuk
• Created: 15/Sep/17 06:58
• Updated: 15/Sep/17 08:18
• Resolved: 15/Sep/17 07:38

Description

All 2.6 builds are failing even though tests report as passing. With each run,
it's a different test that seems to cause the problem, so it's not consistent.

[INFO] Results:
[INFO]
[WARNING] Tests run: 4802, Failures: 0, Errors: 0, Skipped: 35

This seems to be due to a surefire problem with the JVMs created for the
tests:

[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
[ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter1775364586569779113.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun1 surefire5302937670169703589tmp surefire_3565051269905631767801tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.TestHeartbeatHandler
[ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter4243280705420804420.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun4 surefire5453334563682547339tmp surefire_3586448350854680944601tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.TestHeartbeatMonitor
[ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter7638123946663578882.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun2 surefire5447207613794558892tmp surefire_359575380127168860507tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.HeartbeatProcessorTest
[ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter1775364586569779113.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun1 surefire5302937670169703589tmp surefire_3565051269905631767801tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.TestHeartbeatHandler
[ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter4243280705420804420.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun4 surefire5453334563682547339tmp surefire_3586448350854680944601tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.TestHeartbeatMonitor
[ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter7638123946663578882.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun2 surefire5447207613794558892tmp surefire_359575380127168860507tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.HeartbeatProcessorTest
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:494)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:441)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:292)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:243)
[ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1077)
[ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:907)
[ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:785)
[ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
[ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
[ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309)
[ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194)
[ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107)
[ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993)
[ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345)
[ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:191)
[ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[ERROR] at java.lang.reflect.Method.invoke(Method.java:606)
[ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
[ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
[ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
[ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[ERROR] Caused by: org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server && /usr/local/asfpackages/java/jdk1.7.0_80/jre/bin/java -Xmx1024m -XX:MaxPermSize=512m -Xms512m -jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire/surefirebooter7638123946663578882.jar /home/jenkins/jenkins-slave/workspace/Ambari-branch-2.6/ambari-server/target/surefire 2017-08-23T14-58-45_595-jvmRun2 surefire5447207613794558892tmp surefire_359575380127168860507tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1
[ERROR] Crashed tests:
[ERROR] org.apache.ambari.server.agent.HeartbeatProcessorTest
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:679)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:533)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:117)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:429)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:406)
[ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[ERROR] at java.lang.Thread.run(Thread.java:745)
[ERROR]
[ERROR] -> [Help 1]

Issue Links

• links to: ReviewBoard