[HOP-3945] Non-Beam BigQuery Input throws error

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: API, Build, Pipelines, Transforms
• Assignee: Matt Casters
• Reporter: Matt Casters
• Created: 18/May/22 08:24
• Updated: 19/May/22 15:16
• Resolved: 19/May/22 15:16

Description

When running the Beam BigQuery Input transform in a local pipeline engine we get the following error:

2022/05/18 10:15:35 - apache-hop.it.customers.0 - ERROR: java.lang.NoSuchMethodError: 'java.util.List com.google.api.services.bigquery.model.JobConfigurationQuery.getConnectionProperties()'
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.QueryJobConfiguration$Builder.<init>(QueryJobConfiguration.java:255)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.QueryJobConfiguration$Builder.<init>(QueryJobConfiguration.java:96)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.QueryJobConfiguration.fromPb(QueryJobConfiguration.java:1081)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.JobConfiguration.fromPb(JobConfiguration.java:128)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.JobInfo$BuilderImpl.<init>(JobInfo.java:158)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.Job.fromPb(Job.java:497)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:363)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at com.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:340)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at org.apache.hop.beam.transforms.bq.BeamBQInput.processRow(BeamBQInput.java:100)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:51)
2022/05/18 10:15:35 - apache-hop.it.customers.0 -     at java.base/java.lang.Thread.run(Thread.java:829) 

So the google-api-services-bigquery library needs an update.

Issue Links

• links to: GitHub Pull Request #1492