[FLINK-29366] Use flink-shaded-jacson library to parse flink-conf.yaml

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.13.3
• Component/s: API / Core
• Assignee: Unassigned
• Reporter: Yuan Kui
• Created: 21/Sep/22 04:00
• Updated: 21/Sep/22 06:33
• Resolved: 21/Sep/22 06:33

Description

Now we use a simple implementation(org.apache.flink.configuration.GlobalConfiguration#loadYAMLResource) to parse flink-conf.yaml, which can only parse simple key-value pairs.

Although there have been discussions on this issue historically(see:https://github.com/stratosphere/stratosphere/issues/113)
but I think that in the actual production environment, we often need to config complex structure into flink-conf.yaml. At this time, the yaml libary is required for parsing, so I suggest to use the yaml library to parse flink-conf.yaml  instead of our own implementation.

In fact, the flink-core module already has a dependency on flink-shaded-jackson which could parse yaml format,  we can use this jar without more dependencies.

Issue Links

• duplicates: FLINK-23620 Introduce proper YAML parsing to Flink's configuration