[IMPALA-5621] Apply Parquet stats optimizations in conjunction with predicates against Parquet stats

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Backend
• Epic Color: ghx-label-8
• Assignee: Unassigned
• Reporter: Mostafa Mokhtar
• Created: 06/Jul/17 18:30
• Updated: 14/Jul/18 00:45

Description

Impala can skip processing blocks based on predicates against Parquet statistics, for Rowgroups that qualify the predicates use data stored in the Parquet statistics to speedup the query

select count(*), max(ss_item_sk) from store_sales where where ss_item_sk > 10 and ss_item_sk < 9999999999; 

For RowGroups that have min(ss_item_sk) > 10 and max(ss_item_sk) the scanner should use the count stored in the stats opposed to evaluating each row in the RowGroup, same thing applies to min/max values.