Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Patch Available
-
Unknown
Description
When there is 1 consumer connector and multiple consumer threads, the idea to handle consumer offset is to sync all consumer threads via cyclic barrier. In order to make sure threads will step on the barrier - "consumer.timeout.ms" property needs to be set, otherwise all threads may wait infinite time on "hasNext()" iterator call, since number of partitions can be less than number of threads.
Attaching patch which fixes handling of ConsumerTimeoutException.