Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-10060

Provide more informative stage description in Spark Web UI [Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.2.0
    • Fix Version/s: None
    • Component/s: spark-branch
    • Labels:
      None

      Description

      Currently, for HoS in Spark Web UI, it displays stage information like the following:

      Description:
      foreachAsync at RemoteHiveSparkClient.java:254
      org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
      org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254)
      org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366)

      It would be better to provide more useful information, like what is the part of the query that this stage is about. Looks like this is implemented in SparkSQL.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              csun Chao Sun
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: