[SPARK-21691] Accessing canonicalized plan for query with limit throws exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.2.0
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Bjoern Toldbod
• Created: 10/Aug/17 11:11
• Updated: 21/May/19 04:17
• Resolved: 21/May/19 04:17

Description

Accessing the logical, canonicalized plan fails for queries with limits.
The following demonstrates the issue:

val session = SparkSession.builder.master("local").getOrCreate()

// This works
session.sql("select * from (values 0, 1)").queryExecution.logical.canonicalized

// This fails
session.sql("select * from (values 0, 1) limit 1").queryExecution.logical.canonicalized

The message in the thrown exception is somewhat confusing (or at least not directly related to the limit):
"Invalid call to toAttribute on unresolved object, tree: *"