[PIG-5080] Support store alias as spark table

• Type: New Feature
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.16.0
• Fix Version/s: 0.17.1
• Component/s: spark
• Assignee: Jeff Zhang
• Reporter: Jeff Zhang
• Created: 20/Dec/16 06:35
• Updated: 24/Aug/17 15:13

Description

The purpose is that I'd like to take advantage of both pig and hive. Pig-latin has powerful data flow expression ability which is useful for ETL while hive is good at query.

The scenario is that I'd like to store pig alias as spark temporary table (cache can be optional). And I have an another spark engine which share the same SparkContext (in the same JVM) to query the table.

Please close this ticket if it is already supported. I didn't go through all the features of pig-spark.

Issue Links

• is depended upon by: ZEPPELIN-2232 Support Spark SQL for Pig Interpreter