Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1832

HyperLogLog codec performance improvement

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • v1.3.0, v1.5.2
    • v2.0.0
    • Metadata
    • None

    Description

      We have a cube with more than ten distinct count measure, and use hll15 store the value, we found it is too slow of HyperLogLogPlusCounter, there are three methods will called frequentlly: merge/writeRegisters/readRegisters.

      I found in kylin-1.5.x add a parameter 'singleBucket' to store the only one bucket which can optimize base cuboid.

      However, in other step of cuboid building, it will slow down. I has modify the code to speed up the speed of three operation.

      Attachments

        Activity

          People

            xiefan46 XIE FAN
            feng_xiao_yu fengYu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: