[HIVE-18685] Add catalogs to Hive

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Metastore, Parser, Security, SQL
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 12/Feb/18 22:20
• Updated: 21/Nov/19 05:26

Description

SQL supports two levels of namespaces, called in the spec catalogs and schemas (with schema being equivalent to Hive's database).  I propose to add the upper level of catalog.  The attached design doc covers the use cases, requirements, and brief discussion of how it will be implemented in a backwards compatible way.

Issue Links

• blocks: HIVE-21059 Support external catalogs
• relates to: HIVE-15976 Support CURRENT_CATALOG and CURRENT_SCHEMA

Sub-Tasks

• Modifications to the metastore for catalogs: Closed
• Need tool to allow admins to create catalogs and move existing dbs to catalog during upgrade: Closed
• Make Materialized view invalidation cache work with catalogs: Open
• Make transaction system work with catalogs: Open
• Create dedicated objects for DB and Table names: Closed
• Modify TableDesc to contain the catalog: Open
• Make catalogs updatable: Closed
• Modify parser to accept catalog in object names: Open
• Make import/export work with catalogs: Open
• Make new streaming interface work with catalogs: Open
• Make JDBC work with Catalogs: Open
• Make metastore DB backward compatible with pre-catalog versions of hive.: Closed
• Adding defaults for Columns Stats table in the schema to make them backward compatible: Patch Available
• Hive Metastore lock ignores catalog: Open