Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11439 INSERT INTO flink_sql SELECT * FROM blink_sql
  3. FLINK-11488

Add a basic Blink planner framework

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.9.0
    • Table SQL / Planner
    • None

    Description

      A more detailed description can be found in FLIP-32.

      This issue is an umbrella issue for tasks related to the setup of a basic, unified planner framework for introducing new Blink features (in both batch and streaming).

      It includes tasks such as:

      • Introduction of flink-table-planner-blink and flink-table-runtime-blink modules
      • Addition of a planner implementation that matches the interfaces introduced in FLINK-11452
      • Addition of basic planner components such as
        • optimizer
        • statistics
        • costs
        • code generator for expressions

      Types are converted between Blink's and Flink's current type system until the type system has been reworked. Unsupported operators and calls will throw hard exceptions for now.

      Attachments

        Issue Links

          is a parent of

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11679 Create Blink SQL planner and runtime modules

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11680 Make query plan easier to read

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11685 Add plan test infrastructure

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11701 Introduce an abstract set of data formats

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11702 Introduce a new table type system: InternalType

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11703 Introduce TableEnvironment and support registerDataStream and sqlQuery

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11711 Add table and column stats

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11714 Add cost model for both batch and streaming

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11715 Add optimize program to organize optimization phases

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11788 Support Code Generation for RexNode

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11790 Introduce FlinkRelNode interface and FlinkConventions

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11795 Introduce DataStream nodes and converter rules for batch and stream

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11802 Create TypeInfo and TypeSerializer for blink data format

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11803 Improve FlinkTypeFactory for Blink

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11822 Introduce Flink metadata handlers

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11827 Introduce DataFormatConverters to convert internal data format and java format

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11830 Introduce CodeGeneratorContext to maintain reusable statements for code generation

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11834 Introduce flink logical relational nodes

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11839 Introduce FlinkLogicalWindowAggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11840 Introduce FlinkLogicalSnapshot

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11841 Introduce FlinkLogicalSemiJoin

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11842 Introduce FlinkLogicalMatch

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11854 Introduce batch physical nodes

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11896 Introduce stream physical nodes

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11898 Support code generation for all Blink built-in functions and operators

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11932 Add support for generating optimized logical plan for 'select * from mytable'

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11949 Introduce DeclarativeAggregateFunction and AggsHandlerCodeGenerator to blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11966 Add support for generating optimized logical plan for simple query(Project, Filter, Values and Union all)

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12018 Add support for generating optimized logical plan for Sort and Rank

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12076 Add support for generating optimized logical plan for simple group aggregate on batch

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12079 Add support for generating optimized logical plan for join on batch

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12098 Add support for generating optimized logical plan for simple group aggregate on stream

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12161 Supports partial-final optimization for stream group aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12170 Add support for generating optimized logical plan for Over aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12185 Add support for generating optimized logical plan for join on stream

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12192 Add support for generating optimized logical plan for grouping sets and distinct aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12261 Support e2e group window in blink batch

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12263 Remove SINGLE_VALUE aggregate function from physical plan

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12269 Support Temporal Table Join in blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12288 Bump Calcite dependency to 1.19.0 in blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12321 Supports sub-plan reuse

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12345 Add support for generating optimized logical plan for stream window aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12371 Add support for converting (NOT) IN/ (NOT) EXISTS to SemiJoin, and generating optimized logical plan

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12424 Supports dag (multiple-sinks query) optimization

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12487 Introduce planner rules to rewrite expression and merge calc

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12509 Introduce planner rules about non semi/anti join

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12519 Introduce planner rules about semi/anti join

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12524 Introduce planner rules about rank

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12559 Introduce metadata handlers on window aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12575 Introduce planner rules to remove redundant shuffle and collation

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12600 Introduce planner rules to do deterministic rewriting on RelNode

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12610 Introduce planner rules about aggregate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12665 Introduce MiniBatchIntervalInferRule and watermark assigner operators

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12685 Supports UNNEST query in blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12703 Introduce metadata handlers on SEMI/ANTI join and lookup join

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12708 Introduce new Interfaces for source and sink to make Blink runner work

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12805 Introduce PartitionableTableSource for partition pruning

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12815 Supports CatalogManager in blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12856 Introduce planner rule to push projection into TableSource

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-12937 Introduce join reorder planner rules in blink planner

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-13082 Support MatchRecognize in blink planner

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11800 Move table-planner-blink type to table-runtime-blink

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11946 Introduce ExecNode

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11975 Support to run a sql query : 'SELECT * FROM (VALUES (1, 2, 3)) T(a, b, c)'

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11993 Introduce partitionable filesystem sink

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11994 Introduce TableImpl and remove Table in flink-table-planner-blink

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12073 Support appropriate precision and scale processing of Decimal in Blink SQL

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12307 Support translation from StreamExecWindowJoin to StreamTransformation.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12348 Use TableConfig in API module to replace TableConfig in blink-planner-module

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12374 Support translation from StreamExecTableSourceScan/BatchExecTableSourceScan to StreamTransformation.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12496 Support translation from StreamExecGroupWindowAggregate to StreamTransformation.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12734 remove getVolcanoPlanner method from FlinkOptimizeContext and RelNodeBlock does not depend on TableEnvironment

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12795 Extracted creation & configuration of FrameworkConfig & RelBuilder to separate class in blink planner

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12810 Support to run a TableAPI query like 'table.select('a, 'b, 'c)' in Blink runner

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12888 Introduce planner rule to push filter into TableSource

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12969 Remove dependencies on RelNode from TableImpl in blink planner

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12971 Remove the constraint that lookup join needs a primary key or index key

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-12978 Support LookupableTableSource for CsvTableSource

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-13003 Support Temporal TableFunction Join in processing time and event time

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-13076 Bump Calcite dependency to 1.20.0 in blink planner

          • Major - Major loss of function.
          • Closed

          Activity

            People

              godfreyhe godfrey he
              twalthr Timo Walther
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: