Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4258

Real-time OLAP may return incorrect result for some case

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v3.0.0-alpha, v3.0.0-alpha2
    • Fix Version/s: v3.0.0
    • Component/s: Real-time Streaming
    • Labels:
      None

      Description

      1. When real-time query group by minute_start and filter by another column, the aggregate result maybe not correct, the issue has been addressed in KYLIN-4184 , the fix is good, but in  

      NoCompressedColumnReader class, the readBuffer bytes is still shared, it is a potential issue, need to be fixed.

      2. When filter by a minute_start range, the first minute data may not be correct, it is caused by:https://github.com/apache/kylin/blob/master/stream-core/src/main/java/org/apache/kylin/stream/core/storage/columnar/ColumnarSegmentStoreFilesSearcher.java#L68, the fragment's max time is inclusive, but this method's max time is exclusive, that may skip some fragments for the first minute by mistake.

      3. Need to add some UT to cover these two cases.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                magang Gang Ma
                Reporter:
                magang Gang Ma
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: