[BEAM-2985] BigQuery IO write transform is broken for DirectRunner

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: sdk-py-core
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Chamikara Madhusanka Jayalath
• Created: 22/Sep/17 23:20
• Updated: 23/Feb/22 22:28
• Resolved: 25/Sep/17 18:12

Description

I get following error when trying to run BigQuery tornadoes using DirectRunner.

DataflowRunner seems to be working fine.

python -m apache_beam.examples.cookbook.bigquery_tornadoes --output <dataset>.<table> --project <project>

Request missing required parameter projectId
Traceback for above exception (most recent call last):
File "apache_beam/utils/retry.py", line 175, in wrapper
return fun(*args, **kwargs)
File "apache_beam/io/gcp/bigquery.py", line 828, in _get_table
response = self.client.tables.Get(request)
File "apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py", line 608, in Get
config, request, global_params=global_params)
File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 695, in _RunMethod
download)
File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 676, in PrepareHttpRequest
method_config, request, relative_path=url_builder.relative_path)
File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py", line 580, in __ConstructRelativePath
relative_path=relative_path)
File "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/util.py", line 124, in ExpandRelativePath
'Request missing required parameter %s' % param)

Issue Links

• links to: GitHub Pull Request #3892