[HIVE-28490] SharedWorkOptimizer sometimes removes useful DPP sources.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.1.0
• Component/s: Logical Optimizer
• Labels: hive-4.1.0-must pull-request-available
• Target Version/s: 4.1.0
• Assignee: Seonggon Namgung
• Reporter: Seonggon Namgung
• Created: 29/Aug/24 11:12
• Updated: 19/Nov/24 11:34
• Resolved: 19/Nov/24 11:34

Description

Current SharedWorkOptimizer sometimes removes DPP sources that are not invalidated. I found that findAscendantWorkOperators() returns a super set of ascendant operators, which causes wrong DPP source removal.

Please check out the attached slides for detailed explanation.

Issue Links

• links to: GitHub Pull Request #5425