Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7830 Problematic interaction of CEP and asynchronous snapshots
  3. FLINK-6321

RocksDB state backend Checkpointing is not working with KeyedCEP.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.2.0
    • 1.4.1, 1.4.2, 1.5.0
    • Library / CEP
    • None
    • yarn-cluster, RocksDB State backend, Checkpointing every 1000 ms

    Description

      Checkpointing is not working with RocksDBStateBackend when using CEP. It's working fine with FsStateBackend and MemoryStateBackend. Application failing every-time.

      04/18/2017 21:53:20	Job execution switched to status FAILING.
      AsynchronousException{java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).}
      	at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:980)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).
      	... 6 more
      Caused by: java.util.concurrent.CancellationException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:121)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
      	at org.apache.flink.util.FutureUtil.runIfNotDoneAndGet(FutureUtil.java:40)
      	at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:915)
      	... 5 more
      
      

      Attachments

        1. jobmanager.log
          365 kB
          Shashank Agarwal
        2. taskmanager.log
          4.03 MB
          Shashank Agarwal

        Issue Links

          Activity

            People

              kkl0u Kostas Kloudas
              shashank734 Shashank Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: