Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
None
Description
Make StreamPartitionCountMonitor less aggressive and only restart (stateless) or shut down (stateful) the job if partition count increases.
In some versions of KafkaConsumer, partitionFor(topic) can return a count lower than the configured number of partitions if the broker it asks has recently restarted.
The only downside of not restarting the job on partition count decreases is that some containers may be idle.
Attachments
Issue Links
- links to
