[SPARK-8337] KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Done
• Affects Version/s: 1.4.0
• Component/s: DStreams, PySpark
• Assignee: Unassigned
• Reporter: Amit Ramesh
• Created: 13/Jun/15 00:22
• Updated: 07/Sep/17 06:40
• Resolved: 13/Oct/16 09:26

Description

See the following thread for context.

http://apache-spark-developers-list.1001551.n3.nabble.com/Re-Spark-1-4-Python-API-for-getting-Kafka-offsets-in-direct-mode-tt12714.html

Issue Links

• links to: [Github] Pull Request #7410 (jerryshao)

Sub-Tasks

• Expose KafkaRDDs offsetRange in Python: Resolved
• Add the ability to specify message handler function in python similar to Scala/Java: Resolved