Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2985

BigQuery IO write transform is broken for DirectRunner

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: sdk-py-core
    • Labels:
      None

      Description

      I get following error when trying to run BigQuery tornadoes using DirectRunner.

      DataflowRunner seems to be working fine.

      python -m apache_beam.examples.cookbook.bigquery_tornadoes --output <dataset>.<table> --project <project>

      Request missing required parameter projectId
      Traceback for above exception (most recent call last):
      File "apache_beam/utils/retry.py", line 175, in wrapper
      return fun(*args, **kwargs)
      File "apache_beam/io/gcp/bigquery.py", line 828, in _get_table
      response = self.client.tables.Get(request)
      File "apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py", line 608, in Get
      config, request, global_params=global_params)
      File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 695, in _RunMethod
      download)
      File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 676, in PrepareHttpRequest
      method_config, request, relative_path=url_builder.relative_path)
      File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 580, in __ConstructRelativePath
      relative_path=relative_path)
      File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/util.py", line 124, in ExpandRelativePath
      'Request missing required parameter %s' % param)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                chamikara Chamikara Madhusanka Jayalath
                Reporter:
                chamikara Chamikara Madhusanka Jayalath
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: