Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Not A Problem
-
None
-
None
Description
following code in SparkLauncher.java Line 112~116 is about MR plan is generated in Spark mode which is unnecessary.
// Code pulled from MapReduceLauncher MRCompiler mrCompiler = new MRCompiler(physicalPlan, pigContext); mrCompiler.compile(); MROperPlan plan = mrCompiler.getMRPlan(); POPackageAnnotator pkgAnnotator = new POPackageAnnotator(plan); pkgAnnotator.visit();