[FLINK-17149] Introduce Debezium format to support reading debezium changelogs

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
• Labels: pull-request-available
• Assignee: Jark Wu
• Reporter: Jark Wu
• Created: 15/Apr/20 03:28
• Updated: 15/May/20 15:12
• Resolved: 15/May/20 15:10

Description

Introduce DebeziumFormatFactory and DebeziumRowDeserializationSchema to read debezium changelogs.

CREATE TABLE my_table (
  ...
) WITH (
  'connector'='...',  -- e.g. 'kafka'
  'format'='debezium-json',
  'debezium-json.schema-include'='true' -- default false, Debeizum can be configured to include or exclude the message schema
  'debezium-json.ignore-parse-errors'='true' -- default false
);

Issue Links

• links to: GitHub Pull Request #12152