[FLINK-11490] Add an initial Blink SQL batch runtime

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Table SQL / Runtime
• Assignee: Jingsong Lee
• Reporter: Timo Walther
• Created: 31/Jan/19 12:58
• Updated: 27/Sep/19 03:23
• Resolved: 27/Sep/19 02:21

Description

A more detailed description can be found in FLIP-32.

This issue is an umbrella issue for tasks related to the merging of Blink batch runtime features. The goal is to provide minimum viable product (MVP) to batch users.

An exact list of batch features, their properties, and dependencies needs to be defined.

The type system might not have been reworked at this stage. Operations might not be executed with the full performance until changes in other Flink core components have taken place.

Issue Links

• is a parent of: FLINK-11857 Introduce BinaryExternalSorter and BufferedKVExternalSorter to batch table runtime
• is a parent of: FLINK-11863 Introduce channel to read and write compressed data
• is a parent of: FLINK-11881 Introduce code generated typed sort to blink table
• is a parent of: FLINK-11882 Introduce BytesHashMap to batch hash agg
• is a parent of: FLINK-11974 Introduce StreamOperatorFactory to help table perform the whole Operator CodeGen
• is a parent of: FLINK-11981 Introduce ProjectionCodeGenerator and HashCodeGenerator for BaseRow
• is a parent of: FLINK-12013 Support calc and correlate in blink
• is a parent of: FLINK-12041 Introduce ResettableExternalBuffer to blink batch
• is a parent of: FLINK-12077 Introduce HashJoinOperator and LongHashJoinGenerator to blink
• is a parent of: FLINK-12081 Introduce aggregation operator code generator to blink batch
• is a parent of: FLINK-12087 Introduce over window operators to blink batch
• is a parent of: FLINK-12094 Introduce sort merge join operator to blink batch
• is a parent of: FLINK-12120 Support e2e SortAggregate and HashAggregate operator run in batch mode
• is a parent of: FLINK-12140 Support e2e sort merge join operator in batch mode
• is a parent of: FLINK-12168 Support e2e limit, sortLimit, rank, union in blink batch
• is a parent of: FLINK-12211 Add more IT cases to blink batch
• is a parent of: FLINK-12248 Support e2e over window in blink batch
• is a parent of: FLINK-12261 Support e2e group window in blink batch
• is a parent of: FLINK-11856 Introduce BinaryHashTable to batch table runtime
• is a parent of: FLINK-11858 Introduce block compressor/decompressor for batch table runtime
• is a parent of: FLINK-11871 Introduce LongHashTable to improve performance when join key fits in long
• is a parent of: FLINK-11872 update lz4 license file
• is a parent of: FLINK-11993 Introduce partitionable filesystem sink
• is a parent of: FLINK-12563 Introduce vector data format in blink