[KAFKA-9449] Producer's BufferPool may block the producer from closing.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4.1
• Assignee: Brian Byrne
• Reporter: Brian Byrne
• Created: 17/Jan/20 16:49
• Updated: 17/Jan/20 22:32
• Resolved: 17/Jan/20 22:32

Description

The producer's BufferPool may block allocations if its memory limit has hit capacity. If the producer is closed, it's possible for the allocation waiters to wait for max.block.ms if progress cannot be made, even when force-closed (immediate), which can cause indefinite blocking if max.block.ms is particularly high.

The BufferPool should be made close-able, which should immediate wake up any waiters that are pending allocations and throw a "producer is closing" exception.

Issue Links

• links to: GitHub Pull Request #7967