[HBASE-15184] SparkSQL Scan operation doesn't work on kerberos cluster

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, connector-1.0.0
• Component/s: hbase-connectors, spark
• Hadoop Flags: Reviewed

Release Note

Before this patch, users of the spark HBaseContext would fail due to lack of privilege exceptions.

Note:
* It is preferred to have spark in spark-on-yarn mode if Kerberos is used.
* This is orthogonal to issues with a kerberized spark cluster via InputFormats.

 

• Assignee: Theodore michael Malaska
• Reporter: Theodore michael Malaska
• Created: 28/Jan/16 23:54
• Updated: 24/Jun/22 19:34
• Resolved: 24/Feb/16 00:52

Description

I was using the HBase Spark Module at a client with Kerberos and I ran into an issue with the Scan.

I made a fix for the client but we need to put it back into HBase. I will attach my solution, but it has a major problem. I had to over ride a protected class in spark. I will need help to decover a better approach

Issue Links

• blocks: HBASE-14160 backport hbase-spark module to branch-1 and branch-2
• links to: review board