[GOBBLIN-1398] Gobblin kerberos token management for multiple remote hive metastores

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.15.0
• Fix Version/s: 0.17.0
• Assignee: Unassigned
• Reporter: Jay Sen
• Created: 27/Feb/21 22:11
• Updated: 14/Jun/23 04:13

Description

GOBBLIN-1308 takes care of ability to connect to remote and secure hive metastore, but it still requires the management of hive-site to be provided to be container local file. 

When it comes to multiple hive clusters this manual management approach would not work, and requires special feature of providing system specific hive-site.xml without namespace collision.

 

This ticket aims to do following things

1) define a way to provide remote system configuration ( keep giving flat config is more cumbersome )

2) based on system config and feature flag, copy config files to container local path automatically.

3) when creating metastoreClient, pick up the right config for the requested system ( identified by the metastore URI )

 

 

Issue Links

• is related to: GOBBLIN-1308 Gobblin's kerberos token management for remote clusters