-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Not A Problem
-
Affects Version/s: None
-
Fix Version/s: spark-branch
-
Component/s: spark
-
Labels:None
following code in SparkLauncher.java Line 112~116 is about MR plan is generated in Spark mode which is unnecessary.
// Code pulled from MapReduceLauncher MRCompiler mrCompiler = new MRCompiler(physicalPlan, pigContext); mrCompiler.compile(); MROperPlan plan = mrCompiler.getMRPlan(); POPackageAnnotator pkgAnnotator = new POPackageAnnotator(plan); pkgAnnotator.visit();