Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-16601

Display Session Id and Query Name / Id in Spark UI

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • Spark

    Description

      We should display the session id for each HoS Application Launched, and the Query Name / Id and Dag Id for each Spark job launched. Hive-on-MR does something similar via the mapred.job.name parameter. The query name is displayed in the Job Name of the MR app.

      The changes here should also allow us to leverage the config hive.query.name for HoS.

      This should help with debuggability of HoS applications. The Hive-on-Tez UI does something similar.

      Related issues for Hive-on-Tez: HIVE-12357, HIVE-12523

      Attachments

        1. Spark UI Jobs List.png
          251 kB
          Sahil Takiar
        2. Spark UI Applications List.png
          65 kB
          Sahil Takiar
        3. HIVE-16601.8.patch
          11 kB
          Sahil Takiar
        4. HIVE-16601.7.patch
          11 kB
          Sahil Takiar
        5. HIVE-16601.6.patch
          11 kB
          Sahil Takiar
        6. HIVE-16601.5.patch
          10 kB
          Sahil Takiar
        7. HIVE-16601.4.patch
          15 kB
          Sahil Takiar
        8. HIVE-16601.3.patch
          14 kB
          Sahil Takiar
        9. HIVE-16601.2.patch
          14 kB
          Sahil Takiar
        10. HIVE-16601.1.patch
          14 kB
          Sahil Takiar

        Issue Links

          Activity

            People

              stakiar Sahil Takiar
              stakiar Sahil Takiar
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: