Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-911

Abandon producer retry after a certain # of errors

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1
    • None
    • None

    Description

      Currently, the KafkaSystemProducer's producer loop keeps retrying indefinitely when there is an exception in the retryBackOff loop. If there are repeated exceptions, then it makes sense to retry for awhile, and then fail the container.

      Long term, we should focus on getting rid off the retryBackOff loop, and close the producer object in the callback during failure. This will guarantee in-order delivery.

      Attachments

        1. SAMZA-911.0.patch
          8 kB
          Jagadish

        Activity

          People

            jagadish1989@gmail.com Jagadish
            jagadish1989@gmail.com Jagadish
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: