[SPARK-16871] Support getting HBase tokens from multiple clusters dynamically

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.0.0
• Component/s: Spark Core, YARN
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Saisai Shao
• Created: 03/Aug/16 08:22
• Updated: 17/May/20 18:13
• Resolved: 21/May/19 04:32

Description

Current HBase token obtaining mechanism is static, which can only get tokens from the clusters configured in hbase-site.xml and already added in classpath, this may possibly have several shortcomings for the long running services like Zeppelin and others:

1. User may want to access different HBase cluster in a secure way. but currently it can only support one.
2. User may want to change to another the cluster dynamically in the run-time. But current token obtaining mechanism can only support the one configured at the start.

So here propose to improve the current token obtaining mechanism for HBase.

Issue Links

• depends upon: SPARK-14743 Improve delegation token handling in secure clusters