Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3483

Imprecise comparison between double and integer division

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2.5.0
    • Component/s: None
    • Labels:
      None

      Description

      In HLLCSerializer :

                      || averageNumOfElementsInCounter < (m - 5) / (1 + registerIndexSize)) {
      

      The integer division on the right side of < would lose remainder, or fractional part of the quotient.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Aron.tao Jiatao Tao
                Reporter:
                yuzhihong@gmail.com Ted Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: