[MNG-7517] MavenITmng6391PrintVersionTest tests fail under unknown circumstances

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Component/s: Integration Tests
• Assignee: Michael Osipov
• Reporter: Marc Wrobel
• Created: 19/Jul/22 18:03
• Updated: 03/Sep/22 03:57
• Resolved: 26/Jul/22 17:53

Description

When testing PR https://github.com/apache/maven/pull/772 I could not run the Core IT successfully. The MavenITmng6391PrintVersionTest tests (testitShouldPrintVersionAtTopAndAtBottom and itShouldPrintVersionInAllLines) consistently failed on my laptop using the latest build of Maven from https://github.com/apache/maven (master branch - find attached the full build.log) :

$ mvn -B clean install -l /tmp/build.log -Prun-its -DmavenDistro=/home/mwrobel/projects/oss/maven/apache-maven/target/apache-maven-4.0.0-alpha-1-SNAPSHOT-bin.zip
...
[INFO] Running org.apache.maven.it.IntegrationTestSuite
Running integration tests for Maven 4.0.0-alpha-1-SNAPSHOT
    using Maven executable: /home/mwrobel/projects/oss/maven-integration-testing/core-it-suite/target/apache-maven/bin/mvn
    with verifier.forkMode: not defined == fork
Bootstrap.Bootstrap()........................................ OK (2.8 s)
mng6506 PackageAnnotation.GetPackageAnnotation()............. OK (0.8 s)
mng6391 PrintVersion.itShouldPrintVersionAtTopAndAtBottom().. FAILURE (0.1 s)
mng6391 PrintVersion.itShouldPrintVersionInAllLines()........ FAILURE (0.1 s)
mng6386 BaseUriProperty.itMNG6386UnicodeChars().............. OK (0.0 s)
...
[ERROR] Tests run: 915, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 249.505 s <<< FAILURE! - in org.apache.maven.it.IntegrationTestSuite
[ERROR] testitShouldPrintVersionAtTopAndAtBottom(org.apache.maven.it.MavenITmng6391PrintVersionTest)  Time elapsed: 0.054 s  <<< FAILURE!
junit.framework.AssertionFailedError
    at org.apache.maven.it.MavenITmng6391PrintVersionTest.testitShouldPrintVersionAtTopAndAtBottom(MavenITmng6391PrintVersionTest.java:77)[ERROR] testitShouldPrintVersionInAllLines(org.apache.maven.it.MavenITmng6391PrintVersionTest)  Time elapsed: 0.05 s  <<< FAILURE!
junit.framework.AssertionFailedError
    at org.apache.maven.it.MavenITmng6391PrintVersionTest.testitShouldPrintVersionInAllLines(MavenITmng6391PrintVersionTest.java:113)[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR]   MavenITmng6391PrintVersionTest>AbstractMavenIntegrationTestCase.runTest:260->testitShouldPrintVersionAtTopAndAtBottom:77
[ERROR]   MavenITmng6391PrintVersionTest>AbstractMavenIntegrationTestCase.runTest:260->testitShouldPrintVersionInAllLines:113
[INFO] 
[ERROR] Tests run: 915, Failures: 2, Errors: 0, Skipped: 0

The failure is due to the Reactor Summary. Here are the expected and the actual summaries for testitShouldPrintVersionAtTopAndAtBottom :

// expected
[INFO] Reactor Summary for base-project 1.3.0-SNAPSHOT:
[INFO] base-project ....................................... SUCCESS [
[INFO] module-1 ........................................... SUCCESS [
[INFO] module-2 ........................................... SUCCESS [
[INFO] module-3 ........................................... SUCCESS [

// actual
[INFO] Reactor Summary for base-project 1.3.0-SNAPSHOT:
[INFO] base-project ......................................................................................... SUCCESS [
[INFO] module-1 ............................................................................................. SUCCESS [
[INFO] module-2 ............................................................................................. SUCCESS [
[INFO] module-3 ............................................................................................. SUCCESS [

Actual results for both tests are attached.

I used the following versions for both the Maven build and for launching the Core IT :

$ mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /home/mwrobel/.asdf/installs/maven/3.8.6
Java version: 1.8.0_332, vendor: Temurin, runtime: /home/mwrobel/.asdf/installs/java/temurin-8.0.332+9/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "5.10.0-16-amd64", arch: "amd64", family: "unix"

$ echo $SHELL
/bin/bash 
$ bash --version
GNU bash, version 5.1.4(1)-release (x86_64-pc-linux-gnu)

 

Issue Links

• links to: GitHub Pull Request #187