[HBASE-20570] CLONE - Integrate SparkOnHBase into HBase

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: spark

Release Note

This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings:

* Support for Spark and Spark Streaming against Spark 1.3
* RDD/DStream formation from scan operations
* convenience methods for interacting with HBase from an HBase backed RDD / DStream instance
* examples in both the Spark Java API and Spark Scala API
* support for running against a secure HBase cluster

• Assignee: Unassigned
• Reporter: ujjawal kumar
• Created: 11/May/18 08:50
• Updated: 24/Jun/22 19:30
• Resolved: 11/May/18 14:04

Description

This Jira is to ask if SparkOnHBase can find a home in side HBase core.

Here is the github:
https://github.com/cloudera-labs/SparkOnHBase

I am the core author of this project and the license is Apache 2.0

A blog explaining this project is here
http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/

A spark Streaming example is here
http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/

A real customer using this in produce is blogged here
http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/

Please debate and let me know what I can do to make this happen.

Issue Links

• duplicates: HBASE-13992 Integrate SparkOnHBase into HBase
• is a clone of: HBASE-13992 Integrate SparkOnHBase into HBase