Details
-
Improvement
-
Status: Resolved
-
P3
-
Resolution: Won't Fix
-
None
-
None
Description
Jins George jins.george@aeris.net via aermail.onmicrosoft.com
5:50 PM (15 hours ago)
to user
Hello,
I am writing a Beam pipeline(streaming) with Flink runner to consume data from Kafka and apply some transformations and persist to Hbase.
If I restart the application ( due to failure/manual restart), consumer does not resume from the offset where it was prior to restart. It always resume from the latest offset.
If I enable Flink checkpionting with hdfs state back-end, system appears to be resuming from the earliest offset
Is there a recommended way to resume from the offset where it was stopped ?
Thanks,
Jins George