[FLINK-6321] RocksDB state backend Checkpointing is not working with KeyedCEP.

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.4.1, 1.4.2, 1.5.0
• Component/s: Library / CEP

Environment

yarn-cluster, RocksDB State backend, Checkpointing every 1000 ms

• Assignee: Kostas Kloudas
• Reporter: Shashank Agarwal
• Created: 18/Apr/17 13:59
• Updated: 02/Oct/19 17:45
• Resolved: 05/Mar/18 13:07

Description

Checkpointing is not working with RocksDBStateBackend when using CEP. It's working fine with FsStateBackend and MemoryStateBackend. Application failing every-time.

04/18/2017 21:53:20	Job execution switched to status FAILING.
AsynchronousException{java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).}
	at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:980)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).
	... 6 more
Caused by: java.util.concurrent.CancellationException
	at java.util.concurrent.FutureTask.report(FutureTask.java:121)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.flink.util.FutureUtil.runIfNotDoneAndGet(FutureUtil.java:40)
	at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:915)
	... 5 more

Issue Links

• relates to: FLINK-8248 RocksDB state backend Checkpointing is not working with KeyedCEP in 1.4