Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20570

CLONE - Integrate SparkOnHBase into HBase

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: spark
    • Labels:
      None
    • Release Note:
      Hide
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings:

      * Support for Spark and Spark Streaming against Spark 1.3
      * RDD/DStream formation from scan operations
      * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance
      * examples in both the Spark Java API and Spark Scala API
      * support for running against a secure HBase cluster
      Show
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings: * Support for Spark and Spark Streaming against Spark 1.3 * RDD/DStream formation from scan operations * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance * examples in both the Spark Java API and Spark Scala API * support for running against a secure HBase cluster

      Description

      This Jira is to ask if SparkOnHBase can find a home in side HBase core.

      Here is the github:
      https://github.com/cloudera-labs/SparkOnHBase

      I am the core author of this project and the license is Apache 2.0

      A blog explaining this project is here
      http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/

      A spark Streaming example is here
      http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/

      A real customer using this in produce is blogged here
      http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/

      Please debate and let me know what I can do to make this happen.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ted.m Theodore michael Malaska
                Reporter:
                ujjawal ujjawal kumar
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: