[HIVE-21663] Hive Metastore Translation Layer

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Standalone Metastore
• Target Version/s: 4.0.0
• Assignee: Naveen Gangam
• Reporter: Naveen Gangam
• Created: 29/Apr/19 21:19
• Updated: 17/Nov/22 08:50
• Resolved: 16/May/19 18:26

Description

This task is for the implementation of the default provider for translation, that is extensible if needed for a custom translator. Please refer the spec for additional details on the translation.

Issue Links

• is related to: HIVE-19753 Strict managed tables mode in Hive
• relates to: HIVE-25398 Converted external tables should be able to configure purge behaviour
• links to: RB

Sub-Tasks

• HMS Translation layer - Thrift API changes: Closed
• HMS Translation: Pending items from code review: Closed
• Make hive side changes to enforce table access type on queries.: Open
• HMS Translation: External tables with no capabilities returns duplicate entries/: Closed
• HMS Translation: Refactor tests to work with ACID tables.: Closed
• Testcases are randomly failing with ArrayIndexOutOfBoundException: Resolved
• Hive Metastore Translation: Add API call to tell client why table has limited access: Closed
• Hive Metastore Translation: Bucketed table ReadOnly capability: Open
• HMS Translation: Hive need to block create a type of table if the client does not have write capability: Closed
• HMS Translation: Translate getDatabase() API to alter warehouse location: Closed
• Hive.get() resets the capabilities from HiveConf instead of set capabilities: Closed
• Use GetDatabaseResponse to allow for future extension: Open
• HMS Translation layer - Disallow non-ACID MANAGED tables.: Closed
• HMS Translation layer - Turn off HMS Translation by default.: Open
• HMS Translation: Enforce strict locations for managed vs external tables.: Closed
• HMS Translation: Limit translation to hive default catalog only: Closed
• HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables: Closed
• Remove default value for Capabilities from HiveConf: Resolved
• Schema tool enhancements to merge catalogs: Closed
• Disallow ACID table location outside hive warehouse: Open
• Metastore's table location check should be applied when location changed: Closed
• Add support for unmodified_metadata capability: Closed
• transformDatabase() should work with changes from HIVE-22995: Closed
• Ease database managed location restrictions in HMS translation: Closed