[STORM-3175] Use custom Callback in KafkaBolt

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: storm-kafka-client
• Labels: newbie pull-request-available
• Assignee: David DeMar
• Reporter: David DeMar
• Created: 03/Aug/18 02:34
• Updated: 11/Aug/18 08:34
• Resolved: 06/Aug/18 13:55

Description

Currently KafkaBolt completely encapsulates its KafkaProducer so there's no way to inject a custom Callback when sending a message to Kafka. This change will add a method that allows the injection of a Callback function that will be passed into KafkaProducer.send().

The reasoning behind this change is to expose any exceptions that occur during Kafka publishing so they can be logged and have metrics built around them. This would provide more customized ways we could build alerting around Kafka publishing failures.

Issue Links

• links to: GitHub Pull Request #2790