Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3724

Kylin IT test sql is unreasonable

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2.6.0
    • Component/s: None
    • Labels:
      None

      Description

      In kylin-it, we use query under sql_distinct_precisely folder to test the COUNT_DISTINCT(Bitmap) . But we find that query04 using a COUNT_DISTINCT(HLL)  in having condition, it is unreasonable and can cause some data reduction. And I think it maybe causing some unpredictable test failure.

       

      select test_cal_dt.cal_dt,sum(test_kylin_fact.price) as GMV
      , count(1) as TRANS_CNT
      , count(distinct TEST_COUNT_DISTINCT_BITMAP) as user_count
      , count(distinct site_name) as site_count
      from test_kylin_fact
      inner JOIN edw.test_cal_dt as test_cal_dt
      ON test_kylin_fact.cal_dt = test_cal_dt.cal_dt
      inner JOIN test_category_groupings
      on test_kylin_fact.leaf_categ_id = test_category_groupings.leaf_categ_id and
      test_kylin_fact.lstg_site_id = test_category_groupings.site_id
      inner JOIN edw.test_sites as test_sites
      on test_kylin_fact.lstg_site_id = test_sites.site_id
      inner JOIN edw.test_seller_type_dim as test_seller_type_dim
      on test_kylin_fact.slr_segment_cd = test_seller_type_dim.seller_type_cd
      where test_kylin_fact.lstg_format_name='FP-GTC'
      and test_cal_dt.cal_dt between DATE '2013-05-01' and DATE '2013-08-01'
      group by test_cal_dt.cal_dt
      having count(distinct seller_id) > 2

       

       

       

       

       In our jenkin server, sometime we got a build failure, but when I run again without modify code, the CI test pass.

       

       

        Attachments

        1. image-2018-12-17-16-55-13-816.png
          52 kB
          Xiaoxiang Yu
        2. image-2018-12-17-16-58-28-349.png
          495 kB
          Xiaoxiang Yu

          Issue Links

            Activity

              People

              • Assignee:
                hit_lacus Xiaoxiang Yu
                Reporter:
                hit_lacus Xiaoxiang Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: