[HIVE-21599] Wrong results for partitioned Parquet table when files contain partition column

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-beta-1
• Component/s: Query Planning
• Labels: pull-request-available
• Assignee: Soumyakanti Das
• Reporter: Vineet Garg
• Created: 10/Apr/19 18:27
• Updated: 15/Aug/23 06:33
• Resolved: 22/Nov/22 10:42

Description

Filter predicates are pushed to Table Scan (to be pushed to and used by storage handler/input format). Such predicates could consist of partition columns which are of no use to storage handler or input formats. Therefore it should be removed from TS filter expression.

Issue Links

• is duplicated by: HIVE-21632 Hive should not push partition columns to the Parquet predicate, even if the data file contains the partition column
• Testing discovered: HIVE-26755 Wrong results after renaming Parquet column
• links to: GitHub Pull Request #3719
• links to: GitHub Pull Request #3742