[IMPALA-10763] Min/max filters should be enabled on Z-order sorted columns

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Epic Color: ghx-label-14
• Assignee: Qifan Chen
• Reporter: Qifan Chen
• Created: 22/Jun/21 22:40
• Updated: 19/Jul/21 16:04
• Resolved: 19/Jul/21 16:04

Description

Currently, min/max filters are enabled for lexically sorted columns (please refer to
IMPALA-10709: Min/max filters should be enabled for joins on sorted columns in Parquet tables) with a limitation that only the leading sorted columns are assigned with min/max filters. Non-leading sorted columns will be ignored.

To effectively handle multiple sort columns, Impala offers an alternative sort order called Z-order. Z-order sorts these columns in multi-dimension into a sequence of values such that the locality of the data points are preserved.

The purpose of this JIRA is to integrate the min/max filter feature with a table with Z-order sorted columns.