[HIVE-8836] Enable automatic tests with remote spark client [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: 1.1.0
• Component/s: Spark
• Labels: Spark-M3
• Assignee: Rui Li
• Reporter: Chengxiang Li
• Created: 12/Nov/14 08:01
• Updated: 29/May/15 02:31
• Resolved: 28/Nov/14 05:00

Description

In real production environment, remote spark client should be used to submit spark job for Hive mostly, we should enable automatic test with remote spark client to make sure the Hive feature workable with it.

Issue Links

• depends upon: HIVE-8833 Unify spark client API and implement remote spark client.[Spark Branch]
• depends upon: HIVE-8959 SparkSession is not closed until JVM exit.[Spark Branch]
• is duplicated by: HIVE-8795 Switch precommit test from local to local-cluster [Spark Branch]
• is related to: HIVE-7382 Create a MiniSparkCluster and set up a testing framework [Spark Branch]
• is related to: HIVE-8981 Not a directory error in mapjoin_hook.q [Spark Branch]
• is related to: HIVE-8991 Fix custom_input_output_format [Spark Branch]
• is related to: HIVE-8992 Fix bucket related test failure: parquet_join.q [Spark Branch]
• relates to: HIVE-8976 Make nine additional tests deterministic