[STORM-1695] Create trident spout that uses the new kafka consumer API

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-kafka
• Epic Link: Storm-Kafka Refactoring and Improvements
• Assignee: Hugo Da Cruz Louro
• Reporter: Thomas Graves
• Created: 07/Apr/16 16:07
• Updated: 24/Aug/17 05:54
• Resolved: 19/Jan/17 01:13

Description

In storm-822 we added a new kafka spout (org.apache.storm.kafka.spout.KafkaSpout) that uses the new consumer Api in Kafka 0.9. We decided in that one to handle the Trident support separately. So this jira is to add Trident support for it similar to what OpaqueTridentKafkaSpout does for the kafka old consumer api. We need to support the new consumer api to allow access to a secure Kafka cluster which was added in Kafka 0.9.