[IMPALA-8566] COMPUTE INCREMENTAL STATS sets num_nulls off-by-one

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.2.0
• Fix Version/s: Impala 3.3.0
• Component/s: Backend
• Target Version: Impala 3.3.0
• Epic Color: ghx-label-3
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 20/May/19 20:34
• Updated: 05/May/20 11:16
• Resolved: 21/May/19 17:14

Description

IMPALA-7659 added the population of NULL counts while computing stats, but this functionality isn't working properly for incremental stats. The query is produced correctly, but the null count set in the table is one lower than it should be. In the case that the table has no nulls, this ends up setting a '-1' count, which is interpreted as 'unknown'. In the case that there are nulls, we'll just be a little inaccurate.