[KAFKA-5097] KafkaConsumer.poll throws IllegalStateException

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.10.2.1
• Assignee: Eno Thereska
• Reporter: Ismael Juma
• Created: 20/Apr/17 16:02
• Updated: 28/Apr/17 06:42
• Resolved: 20/Apr/17 20:43

Description

The backport of KAFKA-5075 to 0.10.2 seems to have introduced a regression: If a fetch returns more data than `max.poll.records` and there is a rebalance or the user changes the assignment/subscription after a `poll` that doesn't return all the fetched data, the next call will throw an `IllegalStateException`. More discussion in the following PR that includes a fix:

https://github.com/apache/kafka/pull/2876/files#r112413428

This issue caused a Streams system test to fail, see KAFKA-4755.

We should fix the regression before releasing 0.10.2.1.

Issue Links

• links to: GitHub Pull Request #2876
• links to: GitHub Pull Request #2887