[KYLIN-3483] Imprecise comparison between double and integer division

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: v2.5.0
• Assignee: Jiatao Tao
• Reporter: Ted Yu
• Created: 03/Aug/18 19:51
• Updated: 17/Sep/18 00:59
• Resolved: 06/Aug/18 09:57

Description

In HLLCSerializer :

                || averageNumOfElementsInCounter < (m - 5) / (1 + registerIndexSize)) {

The integer division on the right side of < would lose remainder, or fractional part of the quotient.

Issue Links

• links to: GitHub Pull Request #187