[FLINK-17384] Support reading hbase conf dir from flink-conf.yaml

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.10.0
• Fix Version/s: 1.12.0
• Component/s: Connectors / HBase, Deployment / Scripts
• Labels: pull-request-available

Release Note

After FLINK-17384 hbase connector supports reading hbase configuration directory from flink-conf.yaml through the `env.hbase.conf.dir` property when the `HBASE_CONF_DIR` environment variable is not set.
And If the above strategy fails ,the client is using the HBASE_HOME environment variable. If it is set, the client tries to access $HBASE_HOME /conf .

• Assignee: Jacky Lau
• Reporter: Jacky Lau
• Created: 26/Apr/20 02:20
• Updated: 06/Jun/20 07:11
• Resolved: 04/Jun/20 17:54

Description

Currently when using hbase connector with Flink SQL, below manual steps are required:

1. export HBASE_CONF_DIR
2. add hbase libs to flink_lib(because the hbase connnector doesn't have client's( and others) jar)

And we should improve this.

For 1) we could support read hbase conf dir from flink-conf.yaml just like hadoop/yarn does.

For 2) we should support HBASE_CLASSPATH in config.sh. In case of jar conflicts such as guava, we also should support flink-hbase-shaded just like hadoop does

In this JIRA we focus on implementing the 1st proposal.

Issue Links

• relates to: FLINK-17678 Create flink-sql-connector-hbase module to shade HBase
• links to: GitHub Pull Request #12144