-
Type:
Sub-task
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: spark-branch
-
Component/s: spark
-
Labels:None
In PIG-4374, we generate spark plan in SparkLauncher. In current code, we use SparkLauncher#physicalToRDD which converting physical plan to RDDs. Physical plan can not deal with all the cases. In later code, we can use SparkLauncher#sparkPlanToRDD which converting spark plan to RDDs.