[IGNITE-10208] Verify list of tests after migration to Junit 4 against some prior reference (follow-up to IGNITE-10177)

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: MakeTeamcityGreenAgain
• Assignee: Unassigned
• Reporter: Oleg Ignatenko
• Created: 09/Nov/18 14:07
• Updated: 05/Feb/19 08:49

Description

Migration from Junit 3 to 4 involves manually adding @Test annotation to existing test cases. Since Ignite contains many thousands test cases there is a substantial risk that we may miss some of these in such a transition.

In order to mitigate the risk, suggest to do a check after completion of IGNITE-10177 and IGNITE-10762 - somehow generate list of tests in the project and compare it against similar list of tests of some "known good" prior project version (at this point, 2.7 release branch looks like a good candidate for such a reference).

If comparison shows that some test cases from older version are missed in newer one, open a ticket to investigate that.

Comparison is better done using nightly run-all test set as it is the most comprehensive.

Issue Links

• depends upon: IGNITE-10177 cleanup Junit 3 from the project
• depends upon: IGNITE-10762 Migrate test suites from Junit 3 to 4
• is related to: IGNITE-10629 Migration follow up: check for old style tests that could be slipped through in transition period
• is related to: IGNITE-11038 recover IgniteCacheTestSuite3 that was lost because of changes made per IGNITE-10796