[SUREFIRE-730] JUnit4RunListener does not report results from concurrently running tests correctly

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.5, 2.8.1
• Fix Version/s: 2.9
• Component/s: Junit 4.x support
• Flags: Patch
• Assignee: Kristian Rosenvold
• Reporter: James Neal
• Created: 19/Apr/11 11:34
• Updated: 05/Apr/15 14:53
• Resolved: 19/Apr/11 13:49

Description

JUnit4Listener determines succesful pass of a test via a single boolean flag on the class that is set when a test to "true" when a test is started, set to "false" when a test failed, and checked after a test finishes. If all the tests run in serial, this scheme works, but when the tests are all run in parallel, after the first failed test no other successful tests will be reported as having been run (because after the flag is set to "fail" nothing ever resets it - all the tests have already started).

It would be simple to fix this by changing the single failure flag to a hash map of tests to pass/fail flags, and such a change would greatly improve my quality of life.