Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13992

Integrate SparkOnHBase into HBase

    XMLWordPrintableJSON

Details

    • Hide
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings:

      * Support for Spark and Spark Streaming against Spark 2.1.1
      * RDD/DStream formation from scan operations
      * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance
      * examples in both the Spark Java API and Spark Scala API
      * support for running against a secure HBase cluster
      Show
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings: * Support for Spark and Spark Streaming against Spark 2.1.1 * RDD/DStream formation from scan operations * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance * examples in both the Spark Java API and Spark Scala API * support for running against a secure HBase cluster

    Description

      This Jira is to ask if SparkOnHBase can find a home in side HBase core.

      Here is the github:
      https://github.com/cloudera-labs/SparkOnHBase

      I am the core author of this project and the license is Apache 2.0

      A blog explaining this project is here
      http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/

      A spark Streaming example is here
      http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/

      A real customer using this in produce is blogged here
      http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/

      Please debate and let me know what I can do to make this happen.

      Attachments

        1. HBASE-13992.patch.5
          167 kB
          Theodore michael Malaska
        2. HBASE-13992.patch.4
          137 kB
          Theodore michael Malaska
        3. HBASE-13992.patch.3
          130 kB
          Theodore michael Malaska
        4. HBASE-13992.patch
          141 kB
          Theodore michael Malaska
        5. HBASE-13992.9.patch
          172 kB
          Theodore michael Malaska
        6. HBASE-13992.8.patch
          172 kB
          Theodore michael Malaska
        7. HBASE-13992.7.patch
          169 kB
          Theodore michael Malaska
        8. HBASE-13992.6.patch
          168 kB
          Theodore michael Malaska
        9. HBASE-13992.5.patch
          167 kB
          Theodore michael Malaska
        10. HBASE-13992.12.patch
          176 kB
          Theodore michael Malaska
        11. HBASE-13992.11.patch
          176 kB
          Theodore michael Malaska
        12. HBASE-13992.10.patch
          176 kB
          Theodore michael Malaska

        Issue Links

          Activity

            People

              ted.m Theodore michael Malaska
              ted.m Theodore michael Malaska
              Votes:
              0 Vote for this issue
              Watchers:
              41 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: