Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22817

Use hbase-shaded dependencies in hbase-spark

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: connector-1.0.0
    • Fix Version/s: connector-1.0.1
    • Component/s: hbase-connectors
    • Labels:
      None
    • Release Note:
      Hide
      <!-- markdown -->
      The HBase connector for working with Apache Spark now works with the shaded client artifacts provided by the Apache HBase project and avoids adding additional third party dependencies to the classpath.
      Show
      <!-- markdown --> The HBase connector for working with Apache Spark now works with the shaded client artifacts provided by the Apache HBase project and avoids adding additional third party dependencies to the classpath.

      Description

      We changed the behavior of hbase mapredcp which returns shaded jars.

      So if we run

      spark-shell --driver-class-path `hbase mapredcp`:hbase-spark.jar
      

      then it should work fine, it shouldn't throw any exception when accessing hbase from spark.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                meszibalu Balazs Meszaros
                Reporter:
                meszibalu Balazs Meszaros
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: