Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2720

spark-examples should depend on HBase modules for HBase 0.96+

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      With this change:

      diff --git a/pom.xml b/pom.xml
      index 93ef3b9..092430a 100644
      --- a/pom.xml
      +++ b/pom.xml
      @@ -122,7 +122,7 @@
           <hadoop.version>1.0.4</hadoop.version>
           <protobuf.version>2.4.1</protobuf.version>
           <yarn.version>${hadoop.version}</yarn.version>
      -    <hbase.version>0.94.6</hbase.version>
      +    <hbase.version>0.98.4</hbase.version>
           <zookeeper.version>3.4.5</zookeeper.version>
           <hive.version>0.12.0</hive.version>
           <parquet.version>1.4.3</parquet.version>
      

      I got:

      [ERROR] Failed to execute goal on project spark-examples_2.10: Could not resolve dependencies for project org.apache.spark:spark-examples_2.10:jar:1.1.0-SNAPSHOT: Could not find artifact org.apache.hbase:hbase:jar:0.98.4 in maven-repo (http://repo.maven.apache.org/maven2) -> [Help 1]
      

      To build against HBase 0.96+, spark-examples needs to specify HBase modules (hbase-client, etc) in dependencies - possibly using a new profile.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: