Major Description
Currently, Pig on Spark uses RDD-s. Higher level DataFrame API offers many optimization opportunities like Catalyst optimizer, better serialization (project Tungsten). We should investigate how we can migrate from RDD-s to DataFrames, and does this result in performance improvement.