[SUREFIRE-654] TestNG: Recognize successful tests when using invocationCount and successPercentage parameters on the @Test annotation

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6
• Fix Version/s: 2.18
• Component/s: TestNG support

Environment

Apache Maven 2.2.1 (rdebian-4)
Java version: 1.6.0-18
Java home: /usr/lib/jvm/java-6-openjdk/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux" version: "2.6.35-22-generic" arch: "amd64" Family: "unix"
Ubuntu 10.10

• Assignee: Andreas Gudian
• Reporter: Steve Stodola
• Created: 22/Oct/10 11:29
• Updated: 04/Nov/14 15:10
• Resolved: 29/Oct/14 04:07

Description

Surefire does not recognize successful tests using TestNG with the invocationCount and successPercentage parameters on the @Test annotation. BugTest.java in the attached file has an invocationCount = 100 with a successPercentage = 1. 1 test in 100 needs to pass for the test to be considered successful. However when running mvn clean test Surefire reports the tests as failed. The generated report shows the tests as passing. Surefire should be identifying this test as passing.

Issue Links

• duplicates: SUREFIRE-1113 Build does not fail when successPercentage for @org.testng.annotations.Test() is not met