[SPARK-8389] Expose KafkaRDDs offsetRange in Python

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0
• Component/s: DStreams
• Target Version/s: 1.5.0
• Assignee: Saisai Shao
• Reporter: Tathagata Das
• Created: 16/Jun/15 08:46
• Updated: 26/Nov/15 00:01
• Resolved: 09/Jul/15 20:55

Description

Probably requires creating a JavaKafkaPairRDD and also use that in the python APIs

Issue Links

• blocks: SPARK-8390 Update DirectKafkaWordCount examples to show how offset ranges can be used
• relates to: SPARK-10122 AttributeError: 'RDD' object has no attribute 'offsetRanges'
• relates to: SPARK-12002 offsetRanges attribute missing in Kafka RDD when resuming from checkpoint
• links to: [Github] Pull Request #6846 (koeninger)
• links to: [Github] Pull Request #7185 (jerryshao)