[SUREFIRE-520] Multiple test passes with difference in fail on error

• Type: Wish
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.4.3
• Component/s: JUnit 3.x support
• Environment: Win2k3
• Assignee: Unassigned
• Reporter: Kevin Wilson
• Created: 21/Sep/08 23:19
• Updated: 14/Feb/11 13:04
• Resolved: 14/Feb/11 13:04

Description

Not sure if this is possible with the current version or not, But looking for a way to manage the execution o fthe tests.
The following is the scenario. I am developing a project with agile methods and tdd.

We would like to be able to define the tests that need to run early in our sprint. And get them checked in even before they are passing. However, we do not want these new tests to cause the build to fail. At the same time, there may be historical tests that need to continue to run, and if fail cause the build to fail. At the end of our sprint, we would like to move the tests created into the Regressions suite so that these then cause build failrues. I can do one or the other now in the current environment.

How can I instrument this situation, is it possible with the current versions of the tools.

Any help that can be given, on direction in the current version would be helpful.

For example: if we have the following Junit test configuration.

Current.java - Current Test Suite (fail on error false)

• Sprint3.java - Sprint 3 test suite
  TestFeature 3 - test case for feature 3

Regression.java - Regression Test Suite (fail on error true)

• Sprint2.java - Sprint 2 test suite
  TestFeature2 - TestCase for feature 2
• Sprint1.java - Sprint 1 test sutie
  TestFeature1 - TestCase for feature 1;

At the end of the sprint we would like to create a new Sprint4 and then move the sprint3 suite to the Regression suite.

Thanks,
Kevin