[FLINK-32745] Add a flag to skip InputSelectable preValidate step

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.20.0
• Component/s: API / DataStream, Runtime / Configuration
• Assignee: Unassigned
• Reporter: Chesnay Schepler
• Created: 03/Aug/23 14:42
• Updated: 11/Mar/24 12:44

Description

StreamingJobGraphGenerator#preValidate has a step where it checks that no operator implements InputSelectable if checkpointing is enabled, because these features aren't compatible.

This step can be extremely expensive when the CodeGenOperatorFactory is used, because it requires all generated operator classes to actually be compiled (which usually only happens on the task manager).

If you know what jobs you're running this step can be pure overhead.
It would be nice if we'd have a flag to skip this validation step.