[BEAM-5723] CassandraIO is broken because of use of bad relocation of guava

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.5.0, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.10.0, 2.11.0
• Fix Version/s: 2.12.0
• Component/s: io-java-cassandra
• Assignee: Kenneth Knowles
• Reporter: Arun sethia
• Created: 11/Oct/18 21:39
• Updated: 16/May/20 13:52
• Resolved: 02/Apr/19 16:03

Description

While using apache beam to run dataflow job to read data from BigQuery and Store/Write to Cassandra with following libaries:

1. beam-sdks-java-io-cassandra - 2.6.0
2. beam-sdks-java-io-jdbc - 2.6.0
3. beam-sdks-java-io-google-cloud-platform - 2.6.0
4. beam-sdks-java-core - 2.6.0
5. google-cloud-dataflow-java-sdk-all - 2.5.0
6. google-api-client -1.25.0

 

I am getting following error at the time insert/save data to Cassandra.

[error] (run-main-0) org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NoSuchMethodError: com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture;
org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NoSuchMethodError: com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture;
 at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:332)
 at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:302)
 at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:197)
 at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:64)
 at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
 at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)

Issue Links

• causes: BEAM-4049 Improve write throughput of CassandraIO
• is blocked by: BEAM-6620 Do not relocate guava
• is cloned by: BEAM-6972 LTS backport: CassandraIO is broken because of use of bad relocation of guava
• links to: GitHub Pull Request #7237
• links to: GitHub Pull Request #8178
• links to: GitHub Pull Request #8198