Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-16601

Display Session Id and Query Name / Id in Spark UI



    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: Spark
    • Labels:
    • Target Version/s:


      We should display the session id for each HoS Application Launched, and the Query Name / Id and Dag Id for each Spark job launched. Hive-on-MR does something similar via the mapred.job.name parameter. The query name is displayed in the Job Name of the MR app.

      The changes here should also allow us to leverage the config hive.query.name for HoS.

      This should help with debuggability of HoS applications. The Hive-on-Tez UI does something similar.

      Related issues for Hive-on-Tez: HIVE-12357, HIVE-12523


        1. HIVE-16601.1.patch
          14 kB
          Sahil Takiar
        2. HIVE-16601.2.patch
          14 kB
          Sahil Takiar
        3. HIVE-16601.3.patch
          14 kB
          Sahil Takiar
        4. HIVE-16601.4.patch
          15 kB
          Sahil Takiar
        5. HIVE-16601.5.patch
          10 kB
          Sahil Takiar
        6. HIVE-16601.6.patch
          11 kB
          Sahil Takiar
        7. HIVE-16601.7.patch
          11 kB
          Sahil Takiar
        8. HIVE-16601.8.patch
          11 kB
          Sahil Takiar
        9. Spark UI Applications List.png
          65 kB
          Sahil Takiar
        10. Spark UI Jobs List.png
          251 kB
          Sahil Takiar

          Issue Links



              • Assignee:
                stakiar Sahil Takiar
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                6 Start watching this issue


                • Created: