[FLINK-22764] Disable Values Source node in streaming plan optimization

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.13.0
• Component/s: Table SQL / Planner
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Leonard Xu
• Created: 25/May/21 06:46
• Updated: 04/Feb/22 10:36

Description

The Values Source node may be produced in streaming sql plan optimization by FlinkPruneEmptyRules currently,  and the Values Source will become FINISHED status very soon (the data is bounded) which will lead to the whole job can not do checkpoint and savepoint.

I think we can add an option to enable/disable values source input in streaming sql job to make the job do checkpoint/savepoint normally, in the other hand we can also throw better exception when a Values Source node because many values source node is produced by wrong sql.

 

 

Issue Links

• is related to: FLINK-2491 Support Checkpoints After Tasks Finished