Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-1306

JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test

    Details

    • Type: Test
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.20
    • Component/s: None
    • Labels:
      None

      Description

      All the test methods in JUnit4RerunFailingTestsIT set JUnit Version explicitly to 4.7 by calling setJUnitVersion( "4.7" ). This will in turn set the system property junit.version. The problem with this is, that the pom.xml in the test project (junit4-rerun-failing-tests) uses the property junitVersion instead. The version is set to 4.4 in pom.xml. Furthermore using JUnit 4.7 version in pom.xml results in test failures.

      Suggested solution: Drop the junitVersion property from pom.xml and use junit.version instead, making it possible to set the version from the test cases. Use version 4.12, since there seems to be a regression in 4.7 causing the test to fail with this version.

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build maven-surefire #1648 (See https://builds.apache.org/job/maven-surefire/1648/)
          SUREFIRE-1306: JUnit4RerunFailingTestsIT does not execute with the JUnit (tibor17: rev 15b953000afc26ca3844af7d18fd7b3c9ad26cd5)

          • (edit) surefire-integration-tests/src/test/java/org/apache/maven/surefire/its/JUnit4RerunFailingTestsIT.java
          • (edit) surefire-integration-tests/src/test/resources/junit4-rerun-failing-tests/pom.xml
            SUREFIRE-1306 JUnit4RerunFailingTestsIT does not execute with the (tibor17: rev 195e4833ca7abb0278d34bff94cd7669d5331e45)
          • (edit) surefire-providers/common-junit4/src/main/java/org/apache/maven/surefire/common/junit4/JUnitTestFailureListener.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build maven-surefire #1648 (See https://builds.apache.org/job/maven-surefire/1648/ ) SUREFIRE-1306 : JUnit4RerunFailingTestsIT does not execute with the JUnit (tibor17: rev 15b953000afc26ca3844af7d18fd7b3c9ad26cd5) (edit) surefire-integration-tests/src/test/java/org/apache/maven/surefire/its/JUnit4RerunFailingTestsIT.java (edit) surefire-integration-tests/src/test/resources/junit4-rerun-failing-tests/pom.xml SUREFIRE-1306 JUnit4RerunFailingTestsIT does not execute with the (tibor17: rev 195e4833ca7abb0278d34bff94cd7669d5331e45) (edit) surefire-providers/common-junit4/src/main/java/org/apache/maven/surefire/common/junit4/JUnitTestFailureListener.java
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user Tibor17 commented on the issue:

          https://github.com/apache/maven-surefire/pull/132

          @britter
          Done. Thx.

          Show
          githubbot ASF GitHub Bot added a comment - Github user Tibor17 commented on the issue: https://github.com/apache/maven-surefire/pull/132 @britter Done. Thx.
          Show
          tibor17 Tibor Digana added a comment - https://git-wip-us.apache.org/repos/asf?p=maven-surefire.git;a=commit;h=15b953000afc26ca3844af7d18fd7b3c9ad26cd5 https://git-wip-us.apache.org/repos/asf?p=maven-surefire.git;a=commit;h=195e4833ca7abb0278d34bff94cd7669d5331e45
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user Tibor17 commented on the issue:

          https://github.com/apache/maven-surefire/pull/132

          @britter
          I have fixed the issue but it is JUnit 4.7 issue.
          This is useless `.addGoal( "-Dprovider=surefire-junit4" )` and `.setJUnitVersion( "4.7" )` ditto because it's always the same in every test. WDYT?

          Show
          githubbot ASF GitHub Bot added a comment - Github user Tibor17 commented on the issue: https://github.com/apache/maven-surefire/pull/132 @britter I have fixed the issue but it is JUnit 4.7 issue. This is useless `.addGoal( "-Dprovider=surefire-junit4" )` and `.setJUnitVersion( "4.7" )` ditto because it's always the same in every test. WDYT?
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user britter commented on the issue:

          https://github.com/apache/maven-surefire/pull/132

          @Tibor17 find the build log for running the tests with JUnit 4.7 below. I have not investigated whether it is a regression in JUnit 4.7 or in whether it is a defect in mavne-sureifre. It works with JUnit 4.4 and JUnit 4.12. So probably a regression in 4.7?

          ```
          /Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/bin/java -ea -Dsurefire.version=2.19.1 -Dtestng.version=5.7 "-Dmaven.home=/Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3" -Dmaven.settings.file=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/private/it-settings.xml -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo -Dmaven.test.tmpdir=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target -Duser.localRepository=/Users/bene/.m2/repository -DuseInterpolatedSettings=false -DtestBuildDirectory=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes -Dverifier.forkMode=auto -Didea.launcher.port=7534 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Applications/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/tools.jar:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-report-parser/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-logger-api/target/classes:/Users/bene/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar:/Users/bene/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.0/doxia-sink-api-1.0.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-verifier/1.6/maven-verifier-1.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-settings/2.0.6/maven-settings-2.0.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-utils/1.4.1/plexus-utils-1.4.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-container-default/1.0-alpha-9-stable-1/plexus-container-default-1.0-alpha-9-stable-1.jar:/Users/bene/.m2/repository/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.8/htmlunit-2.8.jar:/Users/bene/.m2/repository/xalan/xalan/2.7.1/xalan-2.7.1.jar:/Users/bene/.m2/repository/xalan/serializer/2.7.1/serializer-2.7.1.jar:/Users/bene/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/Users/bene/.m2/repository/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpmime/4.0.1/httpmime-4.0.1.jar:/Users/bene/.m2/repository/org/apache/james/apache-mime4j/0.6/apache-mime4j-0.6.jar:/Users/bene/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.8/htmlunit-core-js-2.8.jar:/Users/bene/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/bene/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/bene/.m2/repository/net/sourceforge/nekohtml/nekohtml/1.9.14/nekohtml-1.9.14.jar:/Users/bene/.m2/repository/net/sourceforge/cssparser/cssparser/0.9.5/cssparser-0.9.5.jar:/Users/bene/.m2/repository/org/w3c/css/sac/1.3/sac-1.3.jar:/Users/bene/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/Users/bene/.m2/repository/org/apache/maven/maven-artifact/2.2.1/maven-artifact-2.2.1.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-shared-utils/0.9/maven-shared-utils-0.9.jar:/Users/bene/.m2/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar:/Users/bene/.m2/repository/commons-io/commons-io/2.2/commons-io-2.2.jar:/Users/bene/.m2/repository/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/Users/bene/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/Users/bene/.m2/repository/org/easytesting/fest-assert/1.4/fest-assert-1.4.jar:/Users/bene/.m2/repository/org/easytesting/fest-util/1.1.6/fest-util-1.1.6.jar" com.intellij.rt.execution.application.AppMain com.intellij.rt.execution.junit.JUnitStarter -ideVersion5 org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT

          org.apache.maven.surefire.its.fixture.SurefireVerifierException: org.apache.maven.it.VerificationException: Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne

          at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:60)
          at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetry(JUnit4RerunFailingTestsIT.java:220)
          at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetryAllClasses(JUnit4RerunFailingTestsIT.java:193)
          at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsWithOneRetry(JUnit4RerunFailingTestsIT.java:58)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
          at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
          at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
          at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
          at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
          at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
          at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
          at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
          at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
          at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
          at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
          at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
          at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
          at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
          Caused by: org.apache.maven.it.VerificationException: Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne
          at org.apache.maven.it.Verifier.verifyTextInLog(Verifier.java:325)
          at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:56)
          ... 30 more

          org.apache.maven.surefire.its.fixture.SurefireVerifierException: Exit code was non-zero: 1; command line and log =
          /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7 -DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2 -Dparallel=methods -DuseUnlimitedThreads=true test
          Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
          [INFO] Error stacktraces are turned on.
          [INFO] Scanning for projects...
          [WARNING]
          [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT
          [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 42, column 15
          [WARNING]
          [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
          [WARNING]
          [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
          [WARNING]
          [INFO]
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          [INFO]
          [INFO] — maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests —
          [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target
          [INFO]
          [INFO] — maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests —
          [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
          [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources
          [INFO]
          [INFO] — maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests —
          [INFO] No sources to compile
          [INFO]
          [INFO] — maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests —
          [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
          [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources
          [INFO]
          [INFO] — maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests —
          [INFO] Changes detected - recompiling the module!
          [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
          [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes
          [INFO]
          [INFO] — maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests —
          [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports
          [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true

          -------------------------------------------------------
          T E S T S
          -------------------------------------------------------
          Running junit4.FlakyFirstTimeTest
          Error test
          Failing test
          Passing test
          Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<< FAILURE! - in junit4.FlakyFirstTimeTest
          testErrorTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< ERROR!
          java.lang.IllegalArgumentException: ...
          at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53)

          testFailingTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< FAILURE!
          java.lang.AssertionError: Failing test
          at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41)

          Running junit4.PassingTest
          Passing test one
          Passing test two
          Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest

          Results :

          Failed tests:
          FlakyFirstTimeTest.testFailingTestOne:41 Failing test
          Tests in error:
          FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ...

          Tests run: 5, Failures: 1, Errors: 1, Skipped: 0

          [INFO] ------------------------------------------------------------------------
          [INFO] BUILD FAILURE
          [INFO] ------------------------------------------------------------------------
          [INFO] Total time: 2.470 s
          [INFO] Finished at: 2016-11-25T20:39:31+01:00
          [INFO] Final Memory: 16M/209M
          [INFO] ------------------------------------------------------------------------
          [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          [ERROR] java.lang.NullPointerException
          [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
          [ERROR] -> [Help 1]
          org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
          at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
          at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
          at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
          at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
          at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
          at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
          at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
          at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
          at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
          at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
          at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
          at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
          at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
          Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
          ... 20 more
          Caused by: java.lang.RuntimeException: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
          at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
          ... 21 more
          [ERROR]
          [ERROR] Re-run Maven using the -X switch to enable full debug logging.
          [ERROR]
          [ERROR] For more information about the errors and possible solutions, please read the following articles:
          [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

          at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:308)
          at org.apache.maven.surefire.its.fixture.MavenLauncher.execute(MavenLauncher.java:262)
          at org.apache.maven.surefire.its.fixture.MavenLauncher.conditionalExec(MavenLauncher.java:231)
          at org.apache.maven.surefire.its.fixture.MavenLauncher.executeTest(MavenLauncher.java:223)
          at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsTwoRetry(JUnit4RerunFailingTestsIT.java:85)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
          at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
          at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
          at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
          at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
          at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
          at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
          at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
          at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
          at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
          at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
          at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
          at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
          at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
          Caused by: org.apache.maven.it.VerificationException: Exit code was non-zero: 1; command line and log =
          /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7 -DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2 -Dparallel=methods -DuseUnlimitedThreads=true test
          Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
          [INFO] Error stacktraces are turned on.
          [INFO] Scanning for projects...
          [WARNING]
          [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT
          [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 42, column 15
          [WARNING]
          [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
          [WARNING]
          [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
          [WARNING]
          [INFO]
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          [INFO]
          [INFO] — maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests —
          [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target
          [INFO]
          [INFO] — maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests —
          [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
          [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources
          [INFO]
          [INFO] — maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests —
          [INFO] No sources to compile
          [INFO]
          [INFO] — maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests —
          [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
          [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources
          [INFO]
          [INFO] — maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests —
          [INFO] Changes detected - recompiling the module!
          [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
          [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes
          [INFO]
          [INFO] — maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests —
          [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports
          [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true

          -------------------------------------------------------
          T E S T S
          -------------------------------------------------------
          Running junit4.FlakyFirstTimeTest
          Error test
          Failing test
          Passing test
          Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<< FAILURE! - in junit4.FlakyFirstTimeTest
          testErrorTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< ERROR!
          java.lang.IllegalArgumentException: ...
          at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53)

          testFailingTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< FAILURE!
          java.lang.AssertionError: Failing test
          at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41)

          Running junit4.PassingTest
          Passing test one
          Passing test two
          Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest

          Results :

          Failed tests:
          FlakyFirstTimeTest.testFailingTestOne:41 Failing test
          Tests in error:
          FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ...

          Tests run: 5, Failures: 1, Errors: 1, Skipped: 0

          [INFO] ------------------------------------------------------------------------
          [INFO] BUILD FAILURE
          [INFO] ------------------------------------------------------------------------
          [INFO] Total time: 2.470 s
          [INFO] Finished at: 2016-11-25T20:39:31+01:00
          [INFO] Final Memory: 16M/209M
          [INFO] ------------------------------------------------------------------------
          [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          [ERROR] java.lang.NullPointerException
          [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
          [ERROR] -> [Help 1]
          org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
          at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
          at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
          at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
          at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
          at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
          at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
          at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
          at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
          at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
          at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
          at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
          at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
          at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
          Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
          at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
          ... 20 more
          Caused by: java.lang.RuntimeException: There was an error in the forked process
          java.lang.NullPointerException
          at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
          at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
          at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
          at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
          at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
          at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)

          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229)
          at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862)
          at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
          at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
          ... 21 more
          [ERROR]
          [ERROR] Re-run Maven using the -X switch to enable full debug logging.
          [ERROR]
          [ERROR] For more information about the errors and possible solutions, please read the following articles:
          [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

          at org.apache.maven.it.Verifier.executeGoals(Verifier.java:1369)
          at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:299)
          ... 31 more

          junit.framework.AssertionFailedError: wrong number of tests
          Expected :1
          Actual :3
          <Click to see difference>

          at junit.framework.Assert.fail(Assert.java:57)
          at junit.framework.Assert.failNotEquals(Assert.java:329)
          at junit.framework.Assert.assertEquals(Assert.java:78)
          at junit.framework.Assert.assertEquals(Assert.java:234)
          at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:84)
          at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:98)
          at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:56)
          at org.apache.maven.surefire.its.fixture.OutputValidator.assertTestSuiteResults(OutputValidator.java:151)
          at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunOneTestMethod(JUnit4RerunFailingTestsIT.java:177)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
          at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
          at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
          at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
          at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
          at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
          at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
          at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
          at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
          at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
          at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
          at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
          at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
          at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
          at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)

          Process finished with exit code 255
          ```

          Show
          githubbot ASF GitHub Bot added a comment - Github user britter commented on the issue: https://github.com/apache/maven-surefire/pull/132 @Tibor17 find the build log for running the tests with JUnit 4.7 below. I have not investigated whether it is a regression in JUnit 4.7 or in whether it is a defect in mavne-sureifre. It works with JUnit 4.4 and JUnit 4.12. So probably a regression in 4.7? ``` /Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/bin/java -ea -Dsurefire.version=2.19.1 -Dtestng.version=5.7 "-Dmaven.home=/Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3" -Dmaven.settings.file=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/private/it-settings.xml -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo -Dmaven.test.tmpdir=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target -Duser.localRepository=/Users/bene/.m2/repository -DuseInterpolatedSettings=false -DtestBuildDirectory=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes -Dverifier.forkMode=auto -Didea.launcher.port=7534 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Applications/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/tools.jar:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-report-parser/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-logger-api/target/classes:/Users/bene/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar:/Users/bene/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.0/doxia-sink-api-1.0.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-verifier/1.6/maven-verifier-1.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-settings/2.0.6/maven-settings-2.0.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-utils/1.4.1/plexus-utils-1.4.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-container-default/1.0-alpha-9-stable-1/plexus-container-default-1.0-alpha-9-stable-1.jar:/Users/bene/.m2/repository/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.8/htmlunit-2.8.jar:/Users/bene/.m2/repository/xalan/xalan/2.7.1/xalan-2.7.1.jar:/Users/bene/.m2/repository/xalan/serializer/2.7.1/serializer-2.7.1.jar:/Users/bene/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/Users/bene/.m2/repository/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpmime/4.0.1/httpmime-4.0.1.jar:/Users/bene/.m2/repository/org/apache/james/apache-mime4j/0.6/apache-mime4j-0.6.jar:/Users/bene/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.8/htmlunit-core-js-2.8.jar:/Users/bene/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/bene/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/bene/.m2/repository/net/sourceforge/nekohtml/nekohtml/1.9.14/nekohtml-1.9.14.jar:/Users/bene/.m2/repository/net/sourceforge/cssparser/cssparser/0.9.5/cssparser-0.9.5.jar:/Users/bene/.m2/repository/org/w3c/css/sac/1.3/sac-1.3.jar:/Users/bene/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/Users/bene/.m2/repository/org/apache/maven/maven-artifact/2.2.1/maven-artifact-2.2.1.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-shared-utils/0.9/maven-shared-utils-0.9.jar:/Users/bene/.m2/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar:/Users/bene/.m2/repository/commons-io/commons-io/2.2/commons-io-2.2.jar:/Users/bene/.m2/repository/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/Users/bene/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/Users/bene/.m2/repository/org/easytesting/fest-assert/1.4/fest-assert-1.4.jar:/Users/bene/.m2/repository/org/easytesting/fest-util/1.1.6/fest-util-1.1.6.jar" com.intellij.rt.execution.application.AppMain com.intellij.rt.execution.junit.JUnitStarter -ideVersion5 org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT org.apache.maven.surefire.its.fixture.SurefireVerifierException: org.apache.maven.it.VerificationException: Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:60) at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetry(JUnit4RerunFailingTestsIT.java:220) at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetryAllClasses(JUnit4RerunFailingTestsIT.java:193) at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsWithOneRetry(JUnit4RerunFailingTestsIT.java:58) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51) at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237) at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147) Caused by: org.apache.maven.it.VerificationException: Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne at org.apache.maven.it.Verifier.verifyTextInLog(Verifier.java:325) at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:56) ... 30 more org.apache.maven.surefire.its.fixture.SurefireVerifierException: Exit code was non-zero: 1; command line and log = /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7 -DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2 -Dparallel=methods -DuseUnlimitedThreads=true test Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 42, column 15 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] — maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests — [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target [INFO] [INFO] — maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests — [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources [INFO] [INFO] — maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests — [INFO] No sources to compile [INFO] [INFO] — maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests — [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources [INFO] [INFO] — maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests — [INFO] Changes detected - recompiling the module! [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent! [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes [INFO] [INFO] — maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests — [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true ------------------------------------------------------- T E S T S ------------------------------------------------------- Running junit4.FlakyFirstTimeTest Error test Failing test Passing test Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<< FAILURE! - in junit4.FlakyFirstTimeTest testErrorTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< ERROR! java.lang.IllegalArgumentException: ... at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53) testFailingTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< FAILURE! java.lang.AssertionError: Failing test at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41) Running junit4.PassingTest Passing test one Passing test two Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest Results : Failed tests: FlakyFirstTimeTest.testFailingTestOne:41 Failing test Tests in error: FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ... Tests run: 5, Failures: 1, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2.470 s [INFO] Finished at: 2016-11-25T20:39:31+01:00 [INFO] Final Memory: 16M/209M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process [ERROR] java.lang.NullPointerException [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 20 more Caused by: java.lang.RuntimeException: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) ... 21 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:308) at org.apache.maven.surefire.its.fixture.MavenLauncher.execute(MavenLauncher.java:262) at org.apache.maven.surefire.its.fixture.MavenLauncher.conditionalExec(MavenLauncher.java:231) at org.apache.maven.surefire.its.fixture.MavenLauncher.executeTest(MavenLauncher.java:223) at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsTwoRetry(JUnit4RerunFailingTestsIT.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51) at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237) at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147) Caused by: org.apache.maven.it.VerificationException: Exit code was non-zero: 1; command line and log = /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode -Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7 -DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2 -Dparallel=methods -DuseUnlimitedThreads=true test Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 42, column 15 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] — maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests — [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target [INFO] [INFO] — maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests — [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources [INFO] [INFO] — maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests — [INFO] No sources to compile [INFO] [INFO] — maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests — [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources [INFO] [INFO] — maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests — [INFO] Changes detected - recompiling the module! [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent! [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes [INFO] [INFO] — maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests — [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true ------------------------------------------------------- T E S T S ------------------------------------------------------- Running junit4.FlakyFirstTimeTest Error test Failing test Passing test Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<< FAILURE! - in junit4.FlakyFirstTimeTest testErrorTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< ERROR! java.lang.IllegalArgumentException: ... at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53) testFailingTestOne(junit4.FlakyFirstTimeTest) Time elapsed: 0.005 sec <<< FAILURE! java.lang.AssertionError: Failing test at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41) Running junit4.PassingTest Passing test one Passing test two Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest Results : Failed tests: FlakyFirstTimeTest.testFailingTestOne:41 Failing test Tests in error: FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ... Tests run: 5, Failures: 1, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2.470 s [INFO] Finished at: 2016-11-25T20:39:31+01:00 [INFO] Final Memory: 16M/209M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process [ERROR] java.lang.NullPointerException [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 20 more Caused by: java.lang.RuntimeException: There was an error in the forked process java.lang.NullPointerException at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229) at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) ... 21 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException at org.apache.maven.it.Verifier.executeGoals(Verifier.java:1369) at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:299) ... 31 more junit.framework.AssertionFailedError: wrong number of tests Expected :1 Actual :3 <Click to see difference> at junit.framework.Assert.fail(Assert.java:57) at junit.framework.Assert.failNotEquals(Assert.java:329) at junit.framework.Assert.assertEquals(Assert.java:78) at junit.framework.Assert.assertEquals(Assert.java:234) at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:84) at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:98) at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:56) at org.apache.maven.surefire.its.fixture.OutputValidator.assertTestSuiteResults(OutputValidator.java:151) at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunOneTestMethod(JUnit4RerunFailingTestsIT.java:177) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51) at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237) at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147) Process finished with exit code 255 ```
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user Tibor17 commented on the issue:

          https://github.com/apache/maven-surefire/pull/132

          @britter
          The JUnit should be stable. Do you see in stacktrace why it fails with 4.7?
          Is it our problem or JUnit problem?

          Show
          githubbot ASF GitHub Bot added a comment - Github user Tibor17 commented on the issue: https://github.com/apache/maven-surefire/pull/132 @britter The JUnit should be stable. Do you see in stacktrace why it fails with 4.7? Is it our problem or JUnit problem?
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user britter opened a pull request:

          https://github.com/apache/maven-surefire/pull/132

          SUREFIRE-1306: JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test

          Drop the junitVersion property from pom.xml and let the test execute
          with the latest JUnit 4.12 currently available.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/britter/maven-surefire SUREFIRE-1306

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/maven-surefire/pull/132.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #132


          commit 02b6cdb4ee4aa1cbf8c4b300771979d40622781f
          Author: Benedikt Ritter <britter@apache.org>
          Date: 2016-11-22T20:05:13Z

          SUREFIRE-1306: JUnit4RerunFailingTestsIT does not execute with the JUnit
          version configured in the test

          Drop the junitVersion property from pom.xml and let the test execute
          with the latest JUnit 4.12 currently available.


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user britter opened a pull request: https://github.com/apache/maven-surefire/pull/132 SUREFIRE-1306 : JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test Drop the junitVersion property from pom.xml and let the test execute with the latest JUnit 4.12 currently available. You can merge this pull request into a Git repository by running: $ git pull https://github.com/britter/maven-surefire SUREFIRE-1306 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/maven-surefire/pull/132.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #132 commit 02b6cdb4ee4aa1cbf8c4b300771979d40622781f Author: Benedikt Ritter <britter@apache.org> Date: 2016-11-22T20:05:13Z SUREFIRE-1306 : JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test Drop the junitVersion property from pom.xml and let the test execute with the latest JUnit 4.12 currently available.

            People

            • Assignee:
              tibor17 Tibor Digana
              Reporter:
              britter Benedikt Ritter
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development