[SPARK-7138] Add method to BlockGenerator to add multiple records to BlockGenerator with single callback

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: DStreams
• Target Version/s: 1.4.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 24/Apr/15 21:51
• Updated: 01/Aug/15 06:03
• Resolved: 29/Apr/15 02:32

Description

This is to ensure that receivers that receive data in small batches (like Kinesis) and want to add them but want the callback function to be called only once.

This is for internal use only for improvement to Kinesis Receiver that we are planning to do.

Issue Links

• is depended upon by: SPARK-9217 Update Kinesis Receiver to record sequence numbers
• links to: [Github] Pull Request #5695 (tdas)