[SPARK-43475] Expression lineage not handling Window and AggregatePart operators

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.3.2
• Component/s: Optimizer
• Assignee: Unassigned
• Reporter: RK Korlapati
• Created: 12/May/23 00:41
• Updated: 30/May/23 02:25
• Resolved: 30/May/23 02:25

Description

Expression lineage logic (findExpressionAndTrackLineageDown) has missing handling for partial aggregation (AggregatePart) and Window operators. This is prohibiting optimizations such as bloom filters which depends on expression lineage