[SPARK-2492] KafkaReceiver minor changes to align with Kafka 0.8

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.2.0
• Component/s: DStreams
• Target Version/s: 1.1.0
• Assignee: Saisai Shao
• Reporter: Saisai Shao
• Created: 15/Jul/14 13:18
• Updated: 25/Nov/14 14:13
• Resolved: 11/Nov/14 10:23

Description

Update to delete Zookeeper metadata when Kafka's parameter "auto.offset.reset" is set to "smallest", which is aligned with Kafka 0.8's ConsoleConsumer.

Also use Kafka offered API without directly using zkClient.

Issue Links

• is related to: SPARK-2383 With auto.offset.reset, KafkaReceiver potentially deletes Consumer nodes from Zookeeper
• links to: [Github] Pull Request #1420 (jerryshao)