Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3693

TopN, Count distinct incorrect in Spark engine

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v2.5.0, v2.5.1
    • Fix Version/s: v2.5.2
    • Component/s: Spark Engine
    • Labels:
      None

      Description

       Long Chao firstly reported this bug; And then we found the currect integration test didn't cover this count distinct, topn measures with Spark engine. In "ITKylinQueryTest", some queries are not tested in the "left" join case, which means they were not covered the spark case. If we manually change to built the "left join" cube with spark, IT will report wrong result:

       

       

      [ERROR] Failures: 
      [ERROR]   ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountQuery:284->KylinTestBase.execAndCompQuery:544->KylinTestBase.execAndCompQuery:647->KylinTestBase.assertTableEquals:691 value (table=query result of query01, row=0, col=USER_COUNT) expected:<8[46]> but was:<8[52]>
      [ERROR]   ITCombinationTest>ITKylinQueryTest.testTopNQuery:277->KylinTestBase.execAndCompQuery:544->KylinTestBase.execAndCompQuery:647->KylinTestBase.assertTableEquals:691 value (table=query result of query82, row=0, col=CAL_DT) expected:<2012-01-[28]> but was:<2012-01-[05]>
      [INFO] 
      

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shaofengshi Shao Feng Shi
                Reporter:
                shaofengshi Shao Feng Shi
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: