Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20791

Support local aggregate push down for Blink batch planner

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Aggregate operator of Flink SQL is currently fully done at Flink layer. With the developing of storage, many downstream storage of Flink SQL has the ability to deal with Aggregation operator.
      Pushing down Aggregate to data source layer will improve performance from the perspective of the network IO and computation overhead.
       
      I have drafted a design doc for this new feature. https://docs.google.com/document/d/1kGwC_h4qBNxF2eMEz6T6arByOB8yilrPLqDN0QBQXW4/edit?usp=sharing
       
      Any comment or discussion is welcome.

      Discuss thread: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Support-local-aggregate-push-down-for-Blink-batch-planner-td47439.html

        Attachments

          Activity

            People

            • Assignee:
              shared_ptr Sebastian Liu
              Reporter:
              shared_ptr Sebastian Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: