[IGNITE-18251] Refactor testing of ignite-extensions

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: extensions
• Labels: ise teamcity
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Ilya Shishkov
• Reporter: Ilya Shishkov
• Created: 24/Nov/22 12:01
• Updated: 15/May/23 12:02
• Resolved: 15/May/23 12:02

Description

Currently, TeamCity runs tests twice, because test classes are not specified. It leads to running of both suite classes and test classes, included to this test suites. For the ignite-cdc-ext you can see more details in IGNITE-18216.
Arguments are listed below [1]:

-pl modules/%DIR_EXTENSION% -am
-Dmaven.test.failure.ignore=true
-DfailIfNoTests=false
-Dignite.version=%IGNITE_VERSION%

Also, there are following problems:

1. Timeouts of CDC Suite.
2. Zookeeper Ip Finder and AOP has no running test on TC [2, 3].

What should be done:

1. Remove duplication of test runs . It can be done by modifying TC configuration, by changing maven-surefire-plugin settings on pom.xml or by removing of suite classes at all.
2. Split IgniteCdcTestSuite class or remove it at all in order to run CDC tests in parallel.
3. Make separate TC build configurations for corresponding CDC suite classes or set up 'Parallel tests' feature in case if suite class had been removed.
4. To control abandoned tests profile check-test-suites from Ignite must be used (only, if suite classes has not removed).
5. failIfNoTests should be set to 'true' in order to prevent situations when module was not tested.
6. Fix modules without test runs, like Zookeeper Ip Finder and AOP.

Links:

1. https://ci2.ignite.apache.org/admin/editRunType.html?id=template:IgniteExtensions_Tests_RunExtensionTests&runnerId=RUNNER_141&cameFromUrl=%2Fadmin%2FeditBuildRunners.html%3Fid%3Dtemplate%253AIgniteExtensions_Tests_RunExtensionTests%26init%3D1&cameFromTitle=
2. https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_ZookeeperIpFinder?branch=&mode=builds#all-projects
3. https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Aop?mode=builds#all-projects

Issue Links

• is duplicated by: IGNITE-18216 Duplicated CDC test runs on TeamCity
• is duplicated by: IGNITE-18306 [Extensions] Surefire plugin fails to run tests if Junit 5 dependency is peresent in the class path.
• is related to: IGNITE-18209 Reduce binary metadata synchronization time for CDC through Kafka

Sub-Tasks

• Duplicated CDC test runs on TeamCity: Resolved
• Set 'failIfNoTests' option to 'true' for all ignite-extensions builds: Resolved
• Set up parallel feature for CDC build configuration: Resolved
• Fix AOP build config: Resolved
• Remove test suites from ignite-extensions: Resolved
• Add tests for examples of extensions: Resolved