Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15184

SparkSQL Scan operation doesn't work on kerberos cluster

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Before this patch, users of the spark HBaseContext would fail due to lack of privilege exceptions.

      Note:
      * It is preferred to have spark in spark-on-yarn mode if Kerberos is used.
      * This is orthogonal to issues with a kerberized spark cluster via InputFormats.

       
      Show
      Before this patch, users of the spark HBaseContext would fail due to lack of privilege exceptions. Note: * It is preferred to have spark in spark-on-yarn mode if Kerberos is used. * This is orthogonal to issues with a kerberized spark cluster via InputFormats.  

      Description

      I was using the HBase Spark Module at a client with Kerberos and I ran into an issue with the Scan.

      I made a fix for the client but we need to put it back into HBase. I will attach my solution, but it has a major problem. I had to over ride a protected class in spark. I will need help to decover a better approach

        Attachments

        1. HBaseSparkModule.zip
          89 kB
          Theodore michael Malaska
        2. HBASE-15184.1.patch
          8 kB
          Theodore michael Malaska

        Issue Links

          Activity

            People

            • Assignee:
              ted.m Theodore michael Malaska
              Reporter:
              ted.m Theodore michael Malaska

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment