Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6663

Expose current DDL metrics (grouped by type) in the Catalog web UI

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      It helps if the catalog server can expose currently running (counts) DDL and RESET_METADATA requests via the web UI metrics. From an observability/supportability point of view, these numbers help reason about the Cluster behavior during Catalog heavy load or in situations where Catalog server is the bottleneck

      Following are some of the interesting ones that I think are interesting.

      enum TDdlType {
        ALTER_TABLE,
        ALTER_VIEW,
        CREATE_DATABASE,
        CREATE_TABLE,
        CREATE_TABLE_AS_SELECT,
        CREATE_TABLE_LIKE,
        CREATE_VIEW,
        CREATE_FUNCTION,
        COMPUTE_STATS,
        DROP_DATABASE,
        DROP_TABLE,
        DROP_VIEW,
        DROP_FUNCTION,
        CREATE_DATA_SOURCE,
        DROP_DATA_SOURCE,
        DROP_STATS,
        CREATE_ROLE,
        DROP_ROLE,
        GRANT_ROLE,
        REVOKE_ROLE,
        GRANT_PRIVILEGE,
        REVOKE_PRIVILEGE,
        TRUNCATE_TABLE,
      }
      
      TCatalogOpType.RESET_METADATA
      TStmtType.DML
      

      This should be based on the metrics framework added in IMPALA-4886.

      Attachments

        1. catalog_page_original.png
          58 kB
          Tamas Mate
        2. catalog_page_new_top.png
          44 kB
          Tamas Mate
        3. catalog_page_new_bottom_v2.png
          42 kB
          Tamas Mate
        4. catalog_new_operations_page.png
          44 kB
          Tamas Mate
        5. catalog_new_operations_page_v2.png
          72 kB
          Tamas Mate

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tmate Tamas Mate
            bharathv Bharath Vissapragada
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment