[FLINK-20292] Improve the document about table formats overlap in user fat jar

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Documentation, Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: pull-request-available
• Assignee: Leonard Xu
• Reporter: Yun Gao
• Created: 23/Nov/20 09:14
• Updated: 03/Dec/20 08:10
• Resolved: 03/Dec/20 08:10

Description

When testing the Flink 1.12 in a standalone mode cluster, I found that if the user job jar contains both flink-avro and flink-parquet/flink-orc, the FileSystemTableSink would not be able to load the corresponding format factory correctly. But if only one format is dependent it works.

The test project located in here and the test class is FileCompactionTest.

The conflict does not seem to affect the local runner, but only has problem when submitted to the standalone cluster.

If the problem does exists, we might need to fix it or give user some tips about the conflicts. 

Issue Links

• relates to: FLINK-20122 Test Small file compaction
• links to: GitHub Pull Request #14229