Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
In PIG-4374, we generate spark plan in SparkLauncher. In current code, we use SparkLauncher#physicalToRDD which converting physical plan to RDDs. Physical plan can not deal with all the cases. In later code, we can use SparkLauncher#sparkPlanToRDD which converting spark plan to RDDs.