[IMPALA-5963] Extend Catalog metrics to list tables that are being loaded along with the ones in the queue

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: Catalog
• Epic Color: ghx-label-7
• Assignee: Unassigned
• Reporter: Mostafa Mokhtar
• Created: 20/Sep/17 18:27
• Updated: 02/Nov/18 22:36
• Resolved: 02/Nov/18 22:36

Description

The Catalog log prints the information below which doesn't clearly show what tables are being loaded, how long is the queue and how far in the queue is a particular table.

I0920 11:18:35.363430 25757 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:18:35.363581 25757 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:18:46.076735 25760 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
I0920 11:18:46.076875 25760 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:18:46.272711 25753 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
I0920 11:18:46.272855 25753 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:18:48.300680 25752 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
I0920 11:18:48.300765 25758 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
I0920 11:18:48.301048 25752 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:18:48.301106 25758 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:09.699975 25762 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:09.700096 25762 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:12.123028 25755 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:12.123165 25755 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:12.986537 25763 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:12.986656 25763 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:12.986994 25766 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:12.987102 25766 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:14.211904 25759 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:14.212038 25759 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:16.055563 25767 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
I0920 11:19:16.055711 25767 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
I0920 11:19:16.059411 25754 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1