[CAMEL-10213] Camel Kafka doesn't support setting "max.poll.records" and "session.timeout.ms"

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.18.0
• Fix Version/s: 2.18.0
• Component/s: camel-kafka
• Estimated Complexity: Novice
• Assignee: Claus Ibsen
• Reporter: Oliver Holzmann
• Created: 01/Aug/16 10:41
• Updated: 21/Nov/16 15:56
• Resolved: 01/Aug/16 14:28

Description

Currently it is not possible to control the processing time in the poll loop in Camel Kafka consumers.

It is important to have the possibility to control the poll loop by adjusting max.poll.records and session.timeout.ms . Otherwise this warning is produced when consuming a large backlog from kafka topic:

Auto offset commit failed for group consumerGroup: Commit cannot be 
completed since the group has already rebalanced and assigned the 
partitions to another member. This means that the time between 
subsequent calls to poll() was longer than the configured 
session.timeout.ms, which typically implies that the poll loop is spending 
too much time message processing. You can address this either by 
increasing the session timeout or by reducing the maximum size of batches
returned in poll() with max.poll.records.

Please add max.poll.records and session.timeout.ms to Kafka endpoint configuration.

Issue Links

• links to: GitHub Pull Request #1279