[HIVE-26238] Decouple sort filter predicates optimization from digest normalization in CBO

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0-alpha-1
• Fix Version/s: 4.0.0-alpha-2
• Component/s: CBO
• Labels: pull-request-available
• Target Version/s: 4.0.0-alpha-2
• Assignee: Stamatis Zampetakis Assign to me
• Reporter: Stamatis Zampetakis
• Created: 18/May/22 12:22
• Updated: 16/Nov/22 13:50
• Resolved: 10/Jun/22 13:09

Description

HIVE-21857 introduced an optimization for ordering predicates inside a filter based on a cost function. After HIVE-23456, this optimization can run only if the the digest normalization (introduced in CALCITE-2450) in CBO is disabled (via calcite.enable.rexnode.digest.normalize).

The goal of this issue is to decouple the sort predicate optimization from digest normalization. After the changes here the optimization shouldn't be affected by the value of calcite.enable.rexnode.digest.normalize property.

Issue Links

• depends upon: HIVE-23456 Upgrade Calcite version to 1.25.0
• is depended upon by: HIVE-26312 Use default digest normalization strategy in CBO
• relates to: CALCITE-2450 RexSimplify: reorder predicates to a canonical form as a part of RexSimplify
• relates to: HIVE-21857 Sort conditions in a filter predicate to accelerate query processing
• links to: GitHub Pull Request #3299