[SPARK-2803] add Kafka stream feature for fetch messages from specified starting offset position

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: DStreams
• Assignee: Unassigned
• Reporter: pengyanhong
• Created: 02/Aug/14 14:43
• Updated: 12/Sep/15 00:59
• Resolved: 12/Sep/15 00:59

Description

There are some use cases that we want to fetch message from specified offset position, as below:

• replay messages
• deal with transaction
• skip bulk incorrect messages
• random fetch message according to index

Issue Links

• is superceded by: SPARK-4964 Exactly-once + WAL-free Kafka Support in Spark Streaming
• links to: [Github] Pull Request #1602 (pengyanhong)