Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13992

Integrate SparkOnHBase into HBase

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: spark
    • Labels:
      None
    • Release Note:
      Hide
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings:

      * Support for Spark and Spark Streaming against Spark 2.1.1
      * RDD/DStream formation from scan operations
      * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance
      * examples in both the Spark Java API and Spark Scala API
      * support for running against a secure HBase cluster
      Show
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings: * Support for Spark and Spark Streaming against Spark 2.1.1 * RDD/DStream formation from scan operations * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance * examples in both the Spark Java API and Spark Scala API * support for running against a secure HBase cluster

      Description

      This Jira is to ask if SparkOnHBase can find a home in side HBase core.

      Here is the github:
      https://github.com/cloudera-labs/SparkOnHBase

      I am the core author of this project and the license is Apache 2.0

      A blog explaining this project is here
      http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/

      A spark Streaming example is here
      http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/

      A real customer using this in produce is blogged here
      http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/

      Please debate and let me know what I can do to make this happen.

        Attachments

        1. HBASE-13992.10.patch
          176 kB
          Theodore michael Malaska
        2. HBASE-13992.11.patch
          176 kB
          Theodore michael Malaska
        3. HBASE-13992.12.patch
          176 kB
          Theodore michael Malaska
        4. HBASE-13992.5.patch
          167 kB
          Theodore michael Malaska
        5. HBASE-13992.6.patch
          168 kB
          Theodore michael Malaska
        6. HBASE-13992.7.patch
          169 kB
          Theodore michael Malaska
        7. HBASE-13992.8.patch
          172 kB
          Theodore michael Malaska
        8. HBASE-13992.9.patch
          172 kB
          Theodore michael Malaska
        9. HBASE-13992.patch
          141 kB
          Theodore michael Malaska
        10. HBASE-13992.patch.3
          130 kB
          Theodore michael Malaska
        11. HBASE-13992.patch.4
          137 kB
          Theodore michael Malaska
        12. HBASE-13992.patch.5
          167 kB
          Theodore michael Malaska

          Issue Links

            Activity

              People

              • Assignee:
                ted.m Theodore michael Malaska
                Reporter:
                ted.m Theodore michael Malaska
              • Votes:
                0 Vote for this issue
                Watchers:
                42 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: