Uploaded image for project: 'Apache Hop (Retired)'
  1. Apache Hop (Retired)
  2. HOP-3839

Beam Dataflow BigQuery libraries need updating

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 2.0.0
    • API, Beam, Dataflow, Pipelines
    • None

    Description

      When running a Beam BigQuery Input transform on Dataflow we get an error:

      Caused by: java.lang.NoClassDefFoundError: com/google/cloud/bigquery/storage/v1/DataFormat 

      For libraries com.google.apis:google-api-services-bigquery and com.google.api.grpc:proto-google-cloud-bigquerystorage-v1 we need to update to the latest version for security concerns. (2.10.1) 

      Attachments

        Activity

          People

            mcasters Matt Casters
            mcasters Matt Casters
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: