[HIVE-25684] Many (~16K) skipped tests in TestGenericUDFInitializeOnCompareUDF

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Testing Infrastructure
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 09/Nov/21 13:27
• Updated: 17/Nov/22 08:48
• Resolved: 15/Nov/21 16:16

Description

TestGenericUDFInitializeOnCompareUDF is a parameterized test leading to 24K possible test combinations. From those only 7K are actually run and the rest (~16K) are skipped.

mvn test -Dtest=TestGenericUDFInitializeOnCompareUDF
...
[WARNING] Tests run: 24300, Failures: 0, Errors: 0, Skipped: 16452, Time elapsed: 7.098 s - in org.apache.hadoop.hive.ql.udf.generic.TestGenericUDFInitializeOnCompareUDF
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 7848, Failures: 0, Errors: 0, Skipped: 0

This generates a lot of noise in Jenkins CI, where many tests appear as skipped, and it may make people believe it is a problem (side effect of their changes). Moreover, we know in advance which tests are skipped and why so instead of generating invalid parameter combinations we could simply remove those combinations altogether.

Issue Links

• links to: GitHub Pull Request #2775