Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3512

No need to enable kylin.storage.hbase.endpoint-compress-result when the query is related to count distinct of bitmap

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • Backlog
    • None
    • None

    Description

      As we know, roaring bitmap will compress its contents. There's no need to use CompressionUtils.compress to compress again the results of each region, which is time consuming and whose compression ratio is low. One example is as follows:
                                        Etc message: start latency: 39@1,agg done@1094,cpuTime@1090,compress done@4245,server stats done@4246
                                        endpoint.CubeVisitService: Size of final result = 61,157,510 (64,725,324 before compressing)

      Attachments

        Activity

          People

            yaho Zhong Yanghong
            yaho Zhong Yanghong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: