[HBASE-16179] Fix compilation errors when building hbase-spark against Spark 2.0

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, connector-1.0.0
• Component/s: hbase-connectors, spark
• Labels: build
• Hadoop Flags: Reviewed
• Release Note: As of this JIRA, Spark version is upgraded from 1.6 to 2.1.1
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 05/Jul/16 21:16
• Updated: 26/Apr/19 10:14
• Resolved: 09/Mar/18 21:10

Description

I tried building hbase-spark module against Spark-2.0 snapshot and got the following compilation errors:

http://pastebin.com/bg3w247a

Some Spark classes such as DataTypeParser and Logging are no longer accessible to downstream projects.

hbase-spark module should not depend on such classes.

Issue Links

• is duplicated by: HBASE-19856 Missing org/apache/spark/Logging with Spark
• is related to: HBASE-18405 Track scope for HBase-Spark module