Bulk Operation

PIG-4856 Support outer join for SkewedJoin in spark mode

PIG-4856 Enable persist/cache mechanism in Pig

PIG-4856 Fix TestPigRunner.simpleMultiQueryTest3 unit test failure

PIG-4856 Set SPARK_REDUCERS by pig.properties not by system configuration

PIG-4856 Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

PIG-4856 Initialize MRConfiguration.JOB_ID in spark mode correctly

PIG-4856 Initialize PigContants.TASK_INDEX in spark mode correctly

PIG-4856 support outer join for skewedjoin in spark mode

PIG-4856 Create SparkCompiler#getSamplingJob in spark mode

PIG-4856 Optimize sort case when data is skewed

PIG-4856 add a physical operator to broadcast small RDDs

PIG-4856 Remove the deserialize and serialization of JobConf in code for spark mode

PIG-4856 Optimize combine case for spark mode

PIG-4856 Calculate the value of parallism for spark mode

PIG-4856 Run pigmix on spark on yarn with multiple nodes

PIG-4856 Not use OperatorPlan#forceConnect in MultiQueryOptimizationSpark

PIG-4856 Re-design Spark plan to optimize the RDD pipeline

PIG-4856 Implement Skewed join for spark engine

PIG-4856 Use pigmix to test the performance of pig on spark

PIG-4856 MultiQueryOptimizerSpark doesn't remove all redudant nodes in spark plan

PIG-4856 Implement Merge join for spark engine

PIG-4856 Optimization for join/group case for spark mode

PIG-4856 Implement FR Join for spark engine

PIG-4856 Implement secondary sort using one shuffle