[AMQ-5552] introduce a smoke-test profile that is enabled by default and during release:prepare

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: 5.11.0
• Component/s: Distribution, Test Cases
• Labels: distribution mvn smoke tests validation
• Assignee: Gary Tully
• Reporter: Gary Tully
• Created: 30/Jan/15 11:38
• Updated: 07/Jan/21 12:23
• Resolved: 07/Jan/21 12:23

Description

Users should be able to do $>mvn install on trunk or the source distribution and get a validated (smoke-tested) distribution in < 10 minutes.
The smoke-test profile should be enabled for release:prepare

At the moment, more than 3k tests are run, they are not reliable enough and the build is gone for a number of hours. This gives a bad first impression.
Or course we should continue to improve the test suite but this has a totally different focus.

The smoke-test profile takes a smart cross section of tests in each module that validate core functionality.

It will be an interesting challenge to get the selection right; balancing typical use cases with coverage with speed etc.

The tests should be:

• representative of the module functionality
• clean - no hard-coded ports and use only space on target
• fast
• reliable
• can be run in parallel (maybe if it allows more tests to be run in the same time frame)