-
Type:
Bug
-
Status: Closed
-
Priority:
Major
-
Resolution: Won't Fix
-
Affects Version/s: 1.1.1
-
Fix Version/s: None
-
Component/s: Connectors / Kafka
-
Labels:None
Kafka consumers stores in state only kafka offsets and doesn't store last emmited watermarks, this may go to wrong state when checkpoint is restored:
Let's say our watermark is (timestamp - 10) and in case we have the following messages queue results will be different after checkpoint restore and during normal processing:
A(ts = 30)
B(ts = 35)
------ checkpoint goes here
C(ts=15) – this one should be filtered by next time window
D(ts=60)
- links to