[RYA-399] Modify tests to run in random order

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: build
• Assignee: Jeff Dasch
• Reporter: Jeff Dasch
• Created: 05/Oct/17 14:36
• Updated: 05/Oct/17 17:32

Description

By default the maven-surefire-plugin uses -Dsurefire.runOrder=filesystem. If tests are not completely isolated, this can result in host-specific test failures depending on how a host sorts the test.

Recommend changing the runOrder to random, or at a minimum, hourly. This will help improve the robustness of tests in the long term and the expense of random test failures in the near term.

Reference: http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#runOrder

Issue Links

• is related to: RYA-398 MongoEntityIndexTest does not run in isolation