[SAMZA-934] Race condition in Kafka System Producer

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Navina Ramesh
• Reporter: Jagadish
• Created: 14/Apr/16 21:53
• Updated: 14/Apr/16 22:02

Description

There is a race condition in the KafkaSystemProducer class in the access to the sendFailed flag. (in the main and the callback threads). It is possible for a

A. a failure to be masked (or)
B. a failure to repeatedly re-throw exceptions in a loop,

by the write to this flag in another thread. This may lead to holes in processing of messages.

Ideally, failure should immediately shut down the producer in the same callback thread. This will cancel future sends / buffered sends in the producer.