[BEAM-1411] Unable to downgrade to lower guava version after upgrade to beam-0.5

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Not A Problem
• Affects Version/s: 0.5.0
• Fix Version/s: Not applicable
• Component/s: sdk-java-core
• Labels: Done
• Assignee: Davor Bonaci
• Reporter: Michael Luckey
• Created: 07/Feb/17 12:32
• Updated: 06/Oct/20 21:51
• Resolved: 04/May/17 17:01

Description

While testing upgrading to 0.5 version of beam we ran into NoSuchMethodErrors

java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
 at org.apache.beam.sdk.io.hdfs.HDFSFileSource$SerializableSplit.<init>(HDFSFileSource.java:473)
 at org.apache.beam.sdk.io.hdfs.AvroHDFSFileSource$1.apply(AvroHDFSFileSource.java:81)
 at org.apache.beam.sdk.io.hdfs.AvroHDFSFileSource$1.apply(AvroHDFSFileSource.java:78)
 at com.google.common.collect.Lists$TransformingRandomAccessList.get(Lists.java:451)
 at java.util.AbstractList$Itr.next(AbstractList.java:358)
 at org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$InputProvider.getInitialInputs(BoundedReadEvaluatorFactory.java:202)
 at org.apache.beam.runners.direct.RootProviderRegistry.getInitialInputs(RootProviderRegistry.java:65)
 at org.apache.beam.runners.direct.ExecutorServiceParallelExecutor.start(ExecutorServiceParallelExecutor.java:168)
 at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:329)
 at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:71)
 at org.apache.beam.sdk.Pipeline.run(Pipeline.java:178)
 at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:258)

This seems to be caused by the HDFS IO components guava dependency not being shaded - in contrast to the core components - and revealed by the recent update to guava-20.0 and the therefore incorporated api changes made by overloading methods

Did not check, whether more components are affected to.

Issue Links

• is related to: BEAM-1661 shade guava in beam-sdks-java-io-jdbc
• links to: GitHub Pull Request #1954