[FLINK-23054] Correct upsert optimization by upsert keys

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0, 1.13.3
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 21/Jun/21 07:32
• Updated: 23/Sep/21 17:53
• Resolved: 16/Sep/21 02:32

Description

After FLINK-22901.

We can use upsert keys to fix upsert join, upsert rank, and upsert sink.

• For join and rank: if input has no upsert keys, do not use upsert optimization.
• For upsert sink: if input has unique keys but no upsert keys, we need add a materialize operator to produce upsert records.

Issue Links

• relates to: FLINK-20374 Wrong result when shuffling changelog stream on non-primary-key columns
• links to: GitHub Pull Request #16239
• links to: GitHub Pull Request #17230