[KAFKA-16298] Ensure user callbacks exceptions are propagated to the user on consumer poll

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Fix Version/s: 3.8.0
• Component/s: clients, consumer
• Labels: callback kip-848-client-support
• Assignee: Lucas Brutschy
• Reporter: Lianet Magrans
• Created: 22/Feb/24 18:52
• Updated: 26/Apr/24 11:27
• Resolved: 26/Apr/24 11:27

Description

When user-defined callbacks fail with an exception, the expectation is that the error should be propagated to the user as a KafkaExpception and break the poll loop (behaviour in the legacy coordinator). The new consumer executes callbacks in the application thread, and sends an event to the background with the callback result and error if any, passing the error along with the event here to the background thread, but does not seem to propagate the exception to the user.

Issue Links

• links to: GitHub Pull Request #15742