[IMPALA-5185] Parquet scanner should skip pages based on parquet page statistics

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: Impala 2.9.0
• Fix Version/s: Not Applicable
• Component/s: Backend
• Labels: parquet performance
• Epic Link: Improve the reliability and effectiveness of ETL
• Target Version: Product Backlog
• Epic Color: ghx-label-2
• Assignee: Lars Volker
• Reporter: Lars Volker
• Created: 07/Apr/17 20:18
• Updated: 30/Apr/19 19:56
• Resolved: 30/Apr/19 19:56

Description

IMPALA-2328 added support to skip row groups based on row group statistics. We also need to support skipping pages based on page statistics. As a prerequisite the parquet scanners need to be adapted to support synchronous row skipping.

Issue Links

• is a child of: IMPALA-4989 Improve filtering based on parquet::Statistics