[HIVE-10060] Provide more informative stage description in Spark Web UI [Spark Branch]

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.2.0
• Component/s: spark-branch
• Assignee: Unassigned
• Reporter: Chao Sun
• Created: 23/Mar/15 17:59
• Updated: 06/May/15 18:01

Description

Currently, for HoS in Spark Web UI, it displays stage information like the following:

Description:
foreachAsync at RemoteHiveSparkClient.java:254
org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254)
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366)

It would be better to provide more useful information, like what is the part of the query that this stage is about. Looks like this is implemented in SparkSQL.