Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4870 Extend Catalog metrics
  3. IMPALA-5963

Extend Catalog metrics to list tables that are being loaded along with the ones in the queue

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:
      None
    • Epic Color:
      ghx-label-7

      Description

      The Catalog log prints the information below which doesn't clearly show what tables are being loaded, how long is the queue and how far in the queue is a particular table.

      I0920 11:18:35.363430 25757 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:18:35.363581 25757 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:46.076735 25760 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:46.076875 25760 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:46.272711 25753 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:46.272855 25753 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:48.300680 25752 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:48.300765 25758 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:48.301048 25752 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:48.301106 25758 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:09.699975 25762 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:09.700096 25762 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.123028 25755 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.123165 25755 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.986537 25763 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.986656 25763 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.986994 25766 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.987102 25766 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:14.211904 25759 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:14.212038 25759 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:16.055563 25767 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:16.055711 25767 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:16.059411 25754 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mmokhtar Mostafa Mokhtar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: