Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-968

Test summary line does not indicate what was being run when using concurrency

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.14
    • 2.15
    • Maven Surefire Plugin
    • None
    • Ubuntu, JDK 7

    Description

      When running multiple test suites in parallel, Surefire prints summaries of ongoing test counts, but it is not at all clear which results are being summarized. E.g. with forkCount=1C:

      Running CoreJellyTest
      Running org.jvnet.hudson.main.AppTest
      Running org.jvnet.hudson.main.UseRecipesWithJenkinsRuleTest
      Running org.jvnet.hudson.test.MemoryAssertTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.339 sec
      Running org.jvnet.hudson.test.MockFolderTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.719 sec
      Running hudson.bugs.DateConversionTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.867 sec
      Running hudson.bugs.LoginRedirectTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.208 sec
      Running hudson.bugs.JnlpAccessWithSecuredHudsonTest
      Tests run: 538, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.847 sec
      …
      

      It is impossible to tell which results correspond to which test, since there is no way to know which test will finish first. At best you can guess based on the number of test case methods known to be in each class.

      The Tests run summary line should give the suite name.

      Attachments

        Activity

          People

            agudian Andreas Gudian
            jglick Jesse N. Glick
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: