Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25684

Many (~16K) skipped tests in TestGenericUDFInitializeOnCompareUDF

    XMLWordPrintableJSON

Details

    Description

      TestGenericUDFInitializeOnCompareUDF is a parameterized test leading to 24K possible test combinations. From those only 7K are actually run and the rest (~16K) are skipped.

      mvn test -Dtest=TestGenericUDFInitializeOnCompareUDF
      ...
      [WARNING] Tests run: 24300, Failures: 0, Errors: 0, Skipped: 16452, Time elapsed: 7.098 s - in org.apache.hadoop.hive.ql.udf.generic.TestGenericUDFInitializeOnCompareUDF
      [INFO] 
      [INFO] Results:
      [INFO] 
      [INFO] Tests run: 7848, Failures: 0, Errors: 0, Skipped: 0
      

      This generates a lot of noise in Jenkins CI, where many tests appear as skipped, and it may make people believe it is a problem (side effect of their changes). Moreover, we know in advance which tests are skipped and why so instead of generating invalid parameter combinations we could simply remove those combinations altogether.

      Attachments

        1. skipped_tests.png
          338 kB
          Stamatis Zampetakis

        Issue Links

          Activity

            People

              zabetak Stamatis Zampetakis
              zabetak Stamatis Zampetakis
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m