[FLINK-36829] Add better validation of pipeline config

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Flink CDC
• Assignee: Unassigned
• Reporter: Robin Moffatt
• Created: 02/Dec/24 12:05
• Updated: 03/Dec/24 11:28

Description

If the `pipeline` section is missing then the user just gets a NullPointerException error:

❯ bin/flink-cdc.sh mysql-to-doris.yaml
Exception in thread "main" java.lang.NullPointerException
        at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:110)
        at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:95)
        at org.apache.flink.cdc.cli.CliExecutor.run(CliExecutor.java:85)
        at org.apache.flink.cdc.cli.CliFrontend.main(CliFrontend.java:69)

It would be good if Flink CDC validated the YAML config and instead reported to the user e.g. "Pipeline YAML is not valid. `pipeline` section is missing".