[SAMZA-911] Abandon producer retry after a certain # of errors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.1
• Assignee: Jagadish
• Reporter: Jagadish
• Created: 24/Mar/16 00:32
• Updated: 27/Apr/16 22:05
• Resolved: 27/Apr/16 22:05

Description

Currently, the KafkaSystemProducer's producer loop keeps retrying indefinitely when there is an exception in the retryBackOff loop. If there are repeated exceptions, then it makes sense to retry for awhile, and then fail the container.

Long term, we should focus on getting rid off the retryBackOff loop, and close the producer object in the callback during failure. This will guarantee in-order delivery.