[SPARK-36979] Add RewriteLateralSubquery rule into nonExcludableRules

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.2.1
• Component/s: SQL
• Assignee: XiDuo You
• Reporter: XiDuo You
• Created: 12/Oct/21 02:42
• Updated: 19/Jun/22 03:47
• Resolved: 12/Oct/21 23:13

Description

Lateral Join has no meaning without rule `RewriteLateralSubquery`. So now if we set `spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.RewriteLateralSubquery`, the lateral join query will fail with:

java.lang.AssertionError: assertion failed: No plan for LateralJoin lateral-subquery#218

Issue Links

• links to: [Github] Pull Request #34249 (ulysses-you)
• links to: [Github] Pull Request #34260 (ulysses-you)
• links to: [Github] Pull Request #36910 (wangyum)