[BEAM-3433] Allow BigQueryIO to use a different project for the load job in batch mode.

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.5.0
• Component/s: io-java-gcp
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Kevin Peterson
• Created: 08/Jan/18 21:22
• Updated: 16/May/20 13:18
• Resolved: 08/Jun/18 19:10

Description

BigQueryIO is currently configured to always run a batch load job using the same projects as the destination table: https://github.com/apache/beam/blob/192b4c70927901860312f8c8acd27bd47e4a4259/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L256

This may not always be desirable, since a pipeline may have write access to a dataset in a different project, but not jobs.create access in that project. This parameter should be settable in the interface.

Issue Links

• links to: GitHub Pull Request #5178