Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-16601

Display Session Id and Query Name / Id in Spark UI

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • Spark

    Description

      We should display the session id for each HoS Application Launched, and the Query Name / Id and Dag Id for each Spark job launched. Hive-on-MR does something similar via the mapred.job.name parameter. The query name is displayed in the Job Name of the MR app.

      The changes here should also allow us to leverage the config hive.query.name for HoS.

      This should help with debuggability of HoS applications. The Hive-on-Tez UI does something similar.

      Related issues for Hive-on-Tez: HIVE-12357, HIVE-12523

      Attachments

        1. HIVE-16601.1.patch
          14 kB
          Sahil Takiar
        2. HIVE-16601.2.patch
          14 kB
          Sahil Takiar
        3. HIVE-16601.3.patch
          14 kB
          Sahil Takiar
        4. HIVE-16601.4.patch
          15 kB
          Sahil Takiar
        5. HIVE-16601.5.patch
          10 kB
          Sahil Takiar
        6. HIVE-16601.6.patch
          11 kB
          Sahil Takiar
        7. HIVE-16601.7.patch
          11 kB
          Sahil Takiar
        8. HIVE-16601.8.patch
          11 kB
          Sahil Takiar
        9. Spark UI Applications List.png
          65 kB
          Sahil Takiar
        10. Spark UI Jobs List.png
          251 kB
          Sahil Takiar

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stakiar Sahil Takiar Assign to me
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment