Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
-
None
Description
In the specific case where the replication-factor of a topic is 1, when partition reassignment is ongoing, and when a broker is bounced, consumers reliably lose some messages in the stream.
This can be reproduced in system tests where the following error message sis observed:
AssertionError: 737 acked message did not make it to the Consumer. They are: 22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550, 45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717 more. Total Acked: 51809, Total Consumed: 51073. We validated that the first 737 of these missing messages correctly made it into Kafka's data files. This suggests they were lost on their way to the consumer.