[FLINK-25152] FLIP-188: Introduce Built-in Dynamic Table Storage

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Table SQL / API, Table SQL / Ecosystem, Table Store
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 03/Dec/21 07:42
• Updated: 03/Mar/22 02:35
• Resolved: 03/Mar/22 02:35

Description

introduce built-in storage support for dynamic table, a truly unified changelog & table representation, from Flink SQL’s perspective. The storage will improve the usability a lot.

More detail see: https://cwiki.apache.org/confluence/display/FLINK/FLIP-188%3A+Introduce+Built-in+Dynamic+Table+Storage

Issue Links

• duplicates: FLINK-25151 FLIP-188: Introduce Built-in Dynamic Table Storage
• is related to: FLINK-18508 Dynamic source supports statistics and parallelism report
• relates to: FLINK-26116 FLIP-188: Implement Table Store V0.1

Sub-Tasks

• Introduce CatalogLock: Closed
• Introduce ManagedTableFactory: Closed
• Introduce TableDescriptor.forManaged: Closed
• Introduce "ALTER TABLE ... COMPACT" SQL syntax: Closed
• Throw exception when managed table sink needs checkpointing: Closed
• Optimize changelog normalize for the managed table upsert mode: Closed
• Introduce setDeliveryCallback to KafkaWriter: Closed
• Hive supports managed table: Closed
• Implement "ALTER TABLE ... COMPACT" SQL: Closed
• Introduce metadataConsumer to InitContext in Sink: Closed