[FLINK-23962] UpdateKind trait is not propagated properly in changeLog inference for DAG optimizing

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.14.0, 1.13.2
• Fix Version/s: 1.14.0, 1.13.3, 1.15.0
• Component/s: Table SQL / Planner
• Labels: pull-request-available
• Assignee: Shuo Cheng
• Reporter: Shuo Cheng
• Created: 25/Aug/21 07:19
• Updated: 30/Aug/21 13:40
• Resolved: 30/Aug/21 13:40

Description

For sql jobs with multi-sinks, the plan is divided into relNode blocks, changeLog mode should be also inferred among blocks. Currently, updateKind trait is not propagated properly from parent block to child blocks for the following pattern.

 
                             -> block3
block0 -> block1 -> block4
            -> block2

 

In the above example, if block3 requires UB and block2, block4 do not require UB, block1 only contains Calc node.

For Agg in block0, UB should be emitted, but the updateKind for block0 is inferred as ONLY_UPDATE_AFTER.

Issue Links

• links to: GitHub Pull Request #16979