[HIVE-27149] StorageHandler PPD query planning statistics not adjusted for pushedPredicate

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.0.0-alpha-2
• Component/s: StorageHandler
• Assignee: Unassigned
• Reporter: Yi Zhang
• Created: 16/Mar/23 21:03
• Updated: 16/Mar/23 21:03

Description

In StorageHandler PPD, filter predicates can be pushed down to storage and trimmed to a subset residualPredicate, however, at query planning statistics based on filters only consider the 'final' residual predicates, when in fact there are pushedPredicates that should also be considered, this affect reducer parallelism (more reducers than needed)