For the time being, at least, we've decided to build the Spark client (see SPARK-3215) inside Hive. This task tracks merging the ongoing work into the Spark branch.
Integrate with remote Spark context after HIVE-8528 [Spark Branch]
Enhance metrics gathering in Spark Client [Spark Branch]
Add remote interface for SparkContext