[IMPALA-8839] Impala writing data to tables should not lead to incorrect results in Hive

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 3.3.0
• Fix Version/s: Impala 3.3.0
• Epic Color: ghx-label-6
• Assignee: Yongzhi Chen
• Reporter: Yongzhi Chen
• Created: 06/Aug/19 22:26
• Updated: 28/Aug/19 17:57
• Resolved: 28/Aug/19 17:54

Description

This include partitioned/unpartitioned tables:
The proposed solution for this issue is that when Impala writes data to an unpartitioned table, it should update 'COLUMN_STATS_ACCURATE' json structure in table properties by removing its 'COLUMN_STATS' nested field (this will end up in TABLE_PARAMS table in HMS).

The proposed solution for this issue is that when Impala writes data to a partitioned table, it should update 'COLUMN_STATS_ACCURATE' json structure by removing its 'COLUMN_STATS' nested field in the properties of the partitions where data was inserted (PARTITION_PARAMS table in HMS).