Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-953

Multi-module build succeeds even if tests time out

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: 2.13
    • Fix Version/s: None
    • Labels:
      None
    • Environment:
      Ubuntu 12.04. OpenJDK 7u9.

      Description

      We have a multi-module Maven project. One of the modules has the following Surefire configuration:

            <plugin>
              <groupId>org.apache.maven.plugins</groupId>
              <artifactId>maven-surefire-plugin</artifactId>
              <configuration>
                <parallel>classes</parallel>
                <runOrder>random</runOrder>
                <threadCount>1</threadCount>
                <forkedProcessTimeoutInSeconds>300</forkedProcessTimeoutInSeconds>
              </configuration>
            </plugin>
      

      Notice the 300s timeout. We've seen multiple instances where the build succeeds even if the tests time out. Here's an example:

      [INFO] Reactor Summary:
      [INFO] 
      [INFO] Project 1 ......................................... SUCCESS [4.742s]
      [INFO] Project 2 ......................................... SUCCESS [5:15.220s]
      

      Notice that Project 2 (which had the 300s timeout) above has run > 5 min. Earlier, in the log we see this:

      mojoSucceeded org.apache.maven.plugins:maven-surefire-plugin:2.13(default-test)
      [ERROR] There was a timeout or other error in the fork
      [JENKINS] Recording test results
      projectSucceeded <project 2 details>
      

      So clearly Maven did hit a timeout and yet succeeded the build. I'm happy to provide any other information about our setup. I don't have an isolated, reproducible test case yet however.

        Attachments

          Activity

            People

            • Assignee:
              krosenvold Kristian Rosenvold
              Reporter:
              diwakergupta Diwaker Gupta
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: