[HIVE-17751] Separate HMS Client and HMS server into separate sub-modules

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Standalone Metastore
• Assignee: Unassigned Assign to me
• Reporter: Vihang Karajgaonkar
• Created: 10/Oct/17 04:06
• Updated: 30/Jul/21 21:51

Description

external applications which are interfacing with HMS should ideally only include HMSClient library instead of one big library containing server as well. We should ideally have a thin client library so that cross version support for external applications is easier. We should sub-divide the standalone module into possibly 3 modules (one for common classes, one for client classes and one for server) or 2 sub-modules (one for client and one for server) so that we can generate separate jars for HMS client and server.

Issue Links

• is related to: HIVE-19902 Provide Metastore micro-benchmarks
• relates to: HIVE-18776 MaterializationsInvalidationCache loading causes race condition in the metastore
• relates to: HIVE-19418 add background stats updater similar to compactor
• links to: Reviewboard link

Sub-Tasks

• Convert standalone-metastore to a submodule: Closed
• Split server-specific code outside of standalone metastore-common: Closed
• Separate metastore client code into its own module: Patch Available
• HiveMetastoreClient should use reflection to instantiate embedded HMS instance: Closed
• Split MetastoreUtils into common and server-specific parts: Closed
• Remove MetastoreConf dependency on server-specific classes: Closed
• Move non-server related methods from Warehouse to MetastoreUtils: Closed
• Move common classes out of metastore-server: Closed
• Split TxnUtils into common and server parts.: Closed
• Split HMS security classes into client and server parts: Open
• Remove dependency on metastore-server: Closed
• Really move metastore common classes into metastore-common: Closed
• Remove Hive Server dependency on Metastore Server: Closed
• HMS database install tests broken due to db scripts being moved to new module.: Open