[HIVE-11652] Avoid expensive call to removeAll in DefaultGraphWalker

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 2.0.0
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Logical Optimizer, Physical Optimizer
• Assignee: Jesús Camacho Rodríguez
• Reporter: Jesús Camacho Rodríguez
• Created: 26/Aug/15 12:08
• Updated: 27/Feb/24 22:24
• Resolved: 29/Aug/15 09:55

Description

When the plan is too large, the removeAll call in DefaultGraphWalker (line 140) will take very long as it will have to go through the list looking for each of the nodes. We try to get rid of this call by rewriting the logic in the walker.

Issue Links

• is part of: HIVE-11315 Compilation performance issues for large queries
• is related to: HIVE-11847 Avoid expensive call to contains/containsAll in DefaultGraphWalker