[IMPALA-8797] Blacklist "sys" and "information_schema" databases from Hive

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 3.2.0
• Fix Version/s: Impala 3.4.0
• Component/s: Catalog, Frontend
• Epic Color: ghx-label-3
• Assignee: Quanlong Huang
• Reporter: Bharath Vissapragada
• Created: 26/Jul/19 21:31
• Updated: 18/Dec/23 17:16
• Resolved: 05/Sep/19 17:18

Description

HMS exposes these two databases "sys" and "information_schema" which contain tables that expose the underlying meta information in a queryable format. However, Impala cannot read them because they come with custom serde that Impala doesn't support.

From a usability point of view, we should black list those databases from loading, so that users don't see them when querying the database list. I think that is reasonable because they can't query them anyway.

Issue Links

• is related to: IMPALA-12583 Support reading hive "information_schema" views in Impala
• relates to: IMPALA-9052 Events processor goes into error state if there are events on blacklisted db or table
• links to: Code Review

Sub-Tasks

• Impala Doc: Document database and table blacklist: Closed