[KUDU-1215] Add integration for Spark map and foreach partition

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: n/a
• Component/s: integration
• Assignee: Unassigned
• Reporter: Theodore michael Malaska
• Created: 18/Oct/15 18:47
• Updated: 27/Sep/16 17:02
• Resolved: 27/Sep/16 17:02

Description

This jira will add two implicit method to Spark RDD

1. kuduForeachPartition
2. kuduMapPartitions

These method will act like the basic foreach/map partition but they will provide the developer a live client to interact with Kudu

These methods will be accessable from two different call points.
1. Scala RDD
2. KuduContext (which will work for Java)

Issue Links

• blocks: KUDU-1214 Add Integration points for Spark, Spark Streaming, and Spark SQL
• blocks: KUDU-1216 Add integration for Spark DStream map and foreach partition
• blocks: KUDU-1217 Spark SQL Integration with primary key push down predicates