[IMPALA-9669] loaded views are still returned as tables for GET_TABLES in LocalCatalog mode

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 3.3.0, Impala 3.4.0
• Fix Version/s: Impala 4.0.0
• Component/s: Catalog
• Epic Color: ghx-label-7
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 17/Apr/20 09:03
• Updated: 07/Jun/22 07:03
• Resolved: 21/May/20 13:20

Description

It's expected that unloaded views are returned as tables in legacy catalog mode, because they are represented as IncompleteTables which have no difference with normal tables. When the view is loaded (i.e. used once), Impala should be able to get its type and return it correctly for GET_TABLES request.

However, in LocalCatalog mode, the types for loaded views are always TABLE.

For reproducing the issue, there are no easy way to trigger GET_TABLES in command lines. The most easier way may be using HUE:

• Make sure coordinators are in LocalCatalog mode.
• Create a view and run a query on it to make sure it's loaded.
• In HUE's Impala editor, the view is shown as table, no matter how many times we refresh the table list:
  
• In HUE's Hive editor, the view is shown with a view logo:
  

 

Issue Links

• is related to: IMPALA-7127 Fetch-on-demand metadata for the impalad-side catalog
• is related to: IMPALA-7587 Follow up for IMPALA-2636: consider fixing GetTables() for tables with not loaded metadata
• relates to: IMPALA-9670 Fix unloaded views are shown as tables for GET_TABLES requests