[KAFKA-5621] The producer should retry expired batches when retries are enabled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Sumant Tambe
• Reporter: Apurva Mehta
• Created: 20/Jul/17 18:41
• Updated: 26/Jul/18 16:53
• Resolved: 12/Sep/17 19:08

Description

Today, when a batch is expired in the accumulator, a TimeoutException is raised to the user.

It might be better the producer to retry the expired batch rather up to the configured number of retries. This is more intuitive from the user's point of view.

Further the proposed behavior makes it easier for applications like mirror maker to provide ordering guarantees even when batches expire. Today, they would resend the expired batch and it would get added to the back of the queue, causing the output ordering to be different from the input ordering.

Issue Links

• is superceded by: KAFKA-5886 Introduce delivery.timeout.ms producer config (KIP-91)
• mentioned in: Page Loading...