Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-16601

Display Session Id and Query Name / Id in Spark UI

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: Spark
    • Labels:
    • Target Version/s:

      Description

      We should display the session id for each HoS Application Launched, and the Query Name / Id and Dag Id for each Spark job launched. Hive-on-MR does something similar via the mapred.job.name parameter. The query name is displayed in the Job Name of the MR app.

      The changes here should also allow us to leverage the config hive.query.name for HoS.

      This should help with debuggability of HoS applications. The Hive-on-Tez UI does something similar.

      Related issues for Hive-on-Tez: HIVE-12357, HIVE-12523

        Attachments

        1. HIVE-16601.8.patch
          11 kB
          Sahil Takiar
        2. Spark UI Jobs List.png
          251 kB
          Sahil Takiar
        3. HIVE-16601.7.patch
          11 kB
          Sahil Takiar
        4. Spark UI Applications List.png
          65 kB
          Sahil Takiar
        5. HIVE-16601.6.patch
          11 kB
          Sahil Takiar
        6. HIVE-16601.5.patch
          10 kB
          Sahil Takiar
        7. HIVE-16601.4.patch
          15 kB
          Sahil Takiar
        8. HIVE-16601.3.patch
          14 kB
          Sahil Takiar
        9. HIVE-16601.2.patch
          14 kB
          Sahil Takiar
        10. HIVE-16601.1.patch
          14 kB
          Sahil Takiar

          Issue Links

            Activity

              People

              • Assignee:
                stakiar Sahil Takiar
                Reporter:
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: