Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Flink's CEP library is a great library for complex event processing, more and more customers are expressing their interests in it. But it also has some limitations that users usually have to write a lot of code even for a very simple pattern match use case as it currently only supports the Java API.

      CEP DSLs and SQLs strongly resemble each other. CEP's additional features compared to SQL boil down to pattern detection. So It will be awesome to consolidate CEP and SQL. It makes SQL more powerful to support more usage scenario. And it gives users the ability to easily and quickly to build CEP applications.

      The FLIP can be found here:
      https://cwiki.apache.org/confluence/display/FLINK/FLIP-20%3A+Integration+of+SQL+and+CEP

      This is an umbrella issue for the FLIP. We should wait for Calcite 1.13 to start this work.

        Attachments

          Issue Links

          1.
          Support partition by and order by of MATCH_RECOGNIZE Sub-task Closed Dian Fu  
          2.
          Fix EMPTY MATCH bug in CEP. Sub-task Closed Unassigned  
          3.
          Support pattern group in CEP Sub-task Resolved Dian Fu  
          4.
          Support greedy quantifier in CEP Sub-task Resolved Dian Fu  
          5.
          Refactor NFACompiler to reduce code duplication Sub-task Resolved Dian Fu  
          6.
          Not store IterativeCondition with NFA state Sub-task Resolved Jark Wu  
          7.
          Support for quantifier range to CEP's pattern API Sub-task Resolved Dian Fu  
          8.
          Support custom order by in PatternStream Sub-task Closed Dian Fu  
          9.
          Support AFTER MATCH SKIP function in CEP library API Sub-task Resolved Yueting Chen  
          10.
          Add method to check if pattern can produce empty matches Sub-task Resolved Dawid Wysakowicz  
          11.
          Support the basic functionality of MATCH_RECOGNIZE Sub-task Resolved Dian Fu  
          12.
          IterativeCondition should support RichFunction interface Sub-task Closed Dian Fu  
          13.
          Pattern(Flat)SelectFunctions should support RichFunction interface Sub-task Closed Dian Fu  
          14.
          Enable UDFs support in MATCH_RECOGNIZE Sub-task Closed Dawid Wysakowicz  
          15.
          Add access to timerService in Pattern(Flat)SelectFunction Sub-task Closed Dawid Wysakowicz
          16.
          Add functions to return TimeIndicators from MATCH_RECOGNIZE Sub-task Closed Dawid Wysakowicz
          17.
          Support aggregation functions in the define and measures clause of MatchRecognize Sub-task Closed Dawid Wysakowicz
          18.
          Add support for ALL ROWS PER MATCH Sub-task Open Dian Fu
          19.
          Add support for CLASSIFIER() function in MatchRecognize Sub-task Open Dian Fu  
          20.
          Improve support for greedy/reluctant quantifiers Sub-task Open Unassigned  
          21.
          Group patterns should support greedy quantifiers Sub-task Open Unassigned  
          22.
          Support time constraint in MatchRecognize Sub-task Closed Dawid Wysakowicz  
          23.
          Support SUBSETS Sub-task In Progress bupt_ljy
          24.
          Support alterations in patterns Sub-task In Progress Unassigned  
          25.
          Support exclusions in patterns Sub-task Open Unassigned  
          26.
          Support reusing same variable in Pattern Sub-task Open Unassigned  
          27.
          Support physical offset in MATCH_RECOGNIZE (PREV) Sub-task Open Dian Fu  
          28.
          Extend streaming SQL end-to-end test to test MATCH_RECOGNIZE Sub-task Resolved Dawid Wysakowicz  
          29.
          Add MATCH_RECOGNIZE documentation Sub-task Closed Dawid Wysakowicz  
          30.
          Document MATCH_RECOGNIZE Sub-task Closed Dawid Wysakowicz  
          31.
          Support patterns that can produce empty matches Sub-task Open Unassigned  
          32.
          Support DISTINCT aggregates in MATCH_RECOGNIZE Sub-task Open Hequn Cheng  

            Activity

              People

              • Assignee:
                dian.fu Dian Fu
                Reporter:
                jark Jark Wu
              • Votes:
                6 Vote for this issue
                Watchers:
                24 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m