Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15149

Add additional information to ATSHook for Tez UI

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • Hooks
    • None

    Description

      Additional query details wanted for TEZ-3530. The additional details discussed include the following:

      Publish the following info ( in addition to existing bits published today):
      Application Id to which the query was submitted (primary filter)
      DAG Id (primary filter)
      Hive query name (primary filter)
      Hive Configs (everything a set command would provide except for sensitive credential info)
      Potentially publish source of config i.e. set in hive query script vs hive-site.xml, etc.
      Which HiveServer2 the query was submitted to
      *Which IP/host the query was submitted from - not sure what filter support will be available.
      Which execution mode the query is running in (primary filter)
      What submission mode was used (cli/beeline/jdbc, etc)
      User info ( running as, actual end user, etc) - not sure if already present
      Perf logger events. The data published should be able to create a timeline view of the query i.e. actual submission time, query compile timestamps, execution timestamps, post-exec data moves, etc.
      Explain plan with enough details for visualizing.
      Databases and tables being queried (primary filter)
      Yarn queue info (primary filter)
      Caller context (primary filter)
      Original source i.e. submitter
      Thread info in HS2 if needed ( I believe Vikram may have added this earlier )
      Query time taken (with filter support )
      Additional context info e.g. llap instance name and appId if required.

      Attachments

        1. HIVE-15149.1.patch
          12 kB
          Jason Dere
        2. HIVE-15149.2.patch
          14 kB
          Jason Dere
        3. HIVE-15149.3.patch
          14 kB
          Jason Dere
        4. HIVE-15149.4.patch
          14 kB
          Jason Dere
        5. HIVE-15149.5.patch
          13 kB
          Jason Dere

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jdere Jason Dere Assign to me
            jdere Jason Dere
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment