Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: None
    • Component/s: CEP
    • Labels:
      None

      Description

      This issue targets making the operators in the CEP library re-scalable. After this is implemented, the user will be able to take a savepoint and restart his job with a different parallelism.
      This issue depends on https://issues.apache.org/jira/browse/FLINK-5845.

      The way this is done is that we introduce the TimeServiceHandler in the AbstractStreamOperator, which keeps the registered InternalTimerService s (before this was in the AbstractStreamOperator) and a new service called KeyRegistry. The KeyRegistry will be fault tolerant and rescalable and will allow to register keys and a callback which will be invoked for each registered key upon reception of a watermark. This can be seen as keeping (recurring) timers for each of the registered keys that will fire "at the next watermark".

      After introducing this service, upon reception of a watermark, all the processing of the NFAs will be delegated to the callback.

        Attachments

          Activity

            People

            • Assignee:
              kkl0u Kostas Kloudas
              Reporter:
              kkl0u Kostas Kloudas
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: