[SUBMARINE-705] Unable to run tests in spark-security with spark-3.0 + hadoop-3.2 profiles

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Security
• Target Version: 0.6.1
• Assignee: Unassigned
• Reporter: Igor Calabria
• Created: 04/Jan/21 16:18
• Updated: 02/Jul/23 09:27

Description

mvn -pl :submarine-spark-security clean test -Pranger-2.0 -Pspark-3.0  -Phadoop-3.2

Fails with 

*** RUN ABORTED ***
  java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
  at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
  at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
  at org.apache.spark.deploy.SparkHadoopUtil$.org$apache$spark$deploy$SparkHadoopUtil$$appendS3AndSparkHadoopHiveConfigurations(SparkHadoopUtil.scala:456)
  at org.apache.spark.deploy.SparkHadoopUtil$.newConfiguration(SparkHadoopUtil.scala:427)
  at org.apache.spark.deploy.SparkHadoopUtil.newConfiguration(SparkHadoopUtil.scala:122)
  at org.apache.spark.deploy.SparkHadoopUtil.<init>(SparkHadoopUtil.scala:49)
  at org.apache.spark.deploy.SparkHadoopUtil$.instance$lzycompute(SparkHadoopUtil.scala:397)
  at org.apache.spark.deploy.SparkHadoopUtil$.instance(SparkHadoopUtil.scala:397)
  at org.apache.spark.deploy.SparkHadoopUtil$.get(SparkHadoopUtil.scala:418)
  at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:95)

This is most likely caused by a guava version conflict