[HIVE-18361] Extend shared work optimizer to reuse computation beyond work boundaries

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Physical Optimizer
• Labels: TODOC3.0
• Target Version/s: 3.0.0
• Assignee: Jesús Camacho Rodríguez
• Reporter: Jesús Camacho Rodríguez
• Created: 03/Jan/18 04:20
• Updated: 27/Feb/24 22:23
• Resolved: 05/Jan/18 02:45

Description

Follow-up of the work in HIVE-16867.

HIVE-16867 introduced an optimization that identifies scans on input tables that can be merged and reuses the computation that is done in the work containing those scans. In particular, we traverse both parts of the plan upstream and reuse the operators if possible.
Currently, the optimizer will not go beyond the output edge(s) of that work. This extension removes that limitation.

Issue Links

• relates to: HIVE-16867 Extend shared scan optimizer to reuse computation from other operators
• links to: RB link