[FLINK-21142] Flink guava Dependence problem

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.12.0
• Fix Version/s: 1.15.0
• Component/s: Connectors / Hadoop Compatibility, Connectors / Hive
• Labels: auto-unassigned pull-request-available
• Assignee: Timo Walther
• Reporter: YUJIANBO
• Created: 26/Jan/21 05:14
• Updated: 30/Sep/21 14:56
• Resolved: 30/Sep/21 14:56

Description

We set up a new Hadoop cluster, and we use the flink1.12.0 compiled by the previous release-1.12.0 branch.If I add hive jar to flink/lib/, it will report errors.

Operating environment：
    flink1.12.0 
    Hadoop 3.3.0
    hive 3.1.2

Flink run official demo shell： /tmp/yjb/buildjar/flink1.12.0/bin/flink run -m yarn-cluster /usr/local/flink1.12.0/examples/streaming/WordCount.jar

If I put one of the jar flink-sql-connector-hive-3.1.2_2.11-1.12.0.jar or hive-exec-3.1.2.jar in the Lib directory and execute the above shell, an error will be reported  java.lang.NoSuchMethodError : com.google.common . base.Preconditions.checkArgument (ZLjava/lang/String;Ljava/lang/Object;)V. We can see that it's the dependency conflict of guava.

My cluster guava‘s version:
/usr/local/hadoop-3.3.0/share/hadoop/yarn/csi/lib/guava-20.0.jar
/usr/local/hadoop-3.3.0/share/hadoop/common/lib/guava-27.0-jre.jar
/usr/local/apache-hive-3.1.2-bin/lib/guava-20.0.jar
/usr/local/apache-hive-3.1.2-bin/lib/jersey-guava-2.25.1.jar
/usr/local/spark-3.0.1-bin-hadoop3.2/jars/guava-14.0.1.jar

Can you give me some advice？
Thank you！

Issue Links

• links to: GitHub Pull Request #16012