[FLINK-18824] Support serialization for canal-json format

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
• Labels: pull-request-available
• Assignee: CaoZhen
• Reporter: Jark Wu
• Created: 05/Aug/20 07:46
• Updated: 01/Sep/20 05:29
• Resolved: 01/Sep/20 05:29

Description

Currently, canal-json format only support deserialization, but not support serialization. This is not convenient for users to writing changelogs to an message queue.

The serialization for canal-json can follow the json strcuture of Canal, but considering currently Flink can't combine UPDATE_BEFORE and UPDATE_AFTER into a single UPDATE message. We can encode UPDATE_BEFORE and UDPATE_AFTER as DELETE and INSERT canal messages.

Issue Links

• links to: GitHub Pull Request #13122