[SPARK-35294] Migrate to transformWithPruning for top-level rules under catalyst/optimizer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0
• Component/s: Optimizer

Environment

 

 

• Assignee: Yingyi Bu
• Reporter: Yingyi Bu
• Created: 03/May/21 05:57
• Updated: 04/May/21 11:17
• Resolved: 04/May/21 11:17

Description

**List of target rules:

• DecorrelateInnerQuery
• LimitPushDownThroughWindow
• OptimizeCsvJsonExprs
• PropagateEmptyRelation
• PullOutGroupingExpressions
• PushLeftSemiLeftAntiThroughJoin
• ReplaceExceptWithFilter
• RewriteDistinctAggregates
• SimplifyConditionalsInPredicate
• UnwrapCastInBinaryComparison

**

Issue Links

• links to: [Github] Pull Request #32421 (sigmod)