Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3656

Improve HLLCounter performance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: all
    • Fix Version/s: v2.6.0
    • Component/s: None
    • Labels:
      None

      Description

      The current HLLCounter implementation has some room to improve performance, as we find in our product environment.

      1.  Create HLLCounter from another HLLCounter, we can copy register instead of merge
      2. To compute harmonic mean in the HLLCSnapshot, we could
        1. using table to cache all 1/2^r  without computing on the fly
        2. remove floating addition by using integer addition in the bigger loop
        3. remove branch, e.g. needn't checking whether registers[i] is zero or not, although this is minor improvement.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                baibaichen Chang chen
                Reporter:
                baibaichen Chang chen
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: