Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
In order to reuse RDDs across Spark SQL queries (SPARK-11838), we need to know a LogicalPlan a SparkPlan node corresponds to. Unfortunately, once a SparkPlan gets built, it is difficult to go back to LogicalPlan nodes. Ideally, there would be an optional field of the type LogicalPlan in SparkPlan that would get populated as SparkPlan gets built.
Attachments
Issue Links
- blocks
-
SPARK-11838 Spark SQL query fragment RDD reuse across queries
- Resolved
- links to