[HUDI-4806] Use Avro version from root pom file for Flink bundle

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Labels: pull-request-available
• Assignee: Shawn Chang
• Reporter: Shawn Chang

Reviewers

Ethan Guo

• Created: 07/Sep/22 23:35
• Updated: 22/Sep/22 23:56
• Resolved: 13/Sep/22 15:43

Description

In pom of flink bundle it specifically defines avro 1.10.0 as its dependency, but this will cause conflicts with some avro generated classes if the project was built with spark3 profile which uses avro 1.11.0.

Example exception:

{{}}

Caused by: java.lang.NoSuchMethodError: org.apache.hudi.org.apache.avro.specific.SpecificRecordBuilderBase.<init>(Lorg/apache/hudi/org/apache/avro/Schema;Lorg/apache/hudi/org/apache/avro/specific/SpecificData;)V

{{}}

 

We should make avro version consistent across the whole project

 

Also, in flink bundle we are shading avro version so it doesn't matter which avro Flink is using.

Issue Links

• links to: GitHub Pull Request #6628