[FLINK-19822] Remove redundant shuffle for streaming

• Type: Improvement
• Status: In Progress
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Table SQL / Planner
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned pull-request-available
• Assignee: Unassigned
• Reporter: godfrey he
• Created: 27/Oct/20 07:40
• Updated: 28/Aug/23 04:08

Description

This is similar FLINK-12575, we could implement satisfyTraits method for stream nodes to remove redundant shuffle. This could add more possibilities that more operators can be merged into multiple input operator.
Different batch, stream operators require the shuffle keys and the state keys must be exactly the same, otherwise the state may be not correct.
We only support a few operators in this issue, such as Join and regular Aggregate. Other operators will be supported in the future.

Issue Links

• links to: GitHub Pull Request #13832
• links to: GitHub Pull Request #21170