[BEAM-2817] Bigquery queries should allow options to run in batch mode or not

• Type: Bug
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: io-java-gcp
• Labels: newbie starter
• Assignee: Unassigned
• Reporter: Lara Schmidt
• Created: 29/Aug/17 00:14
• Updated: 03/Jun/22 18:39

Description

When bigquery read does a query it sets the mode to batch. A batch query can be very slow to schedule as it batches it with other queries. However it doesn't use batch quota which is better for some cases. However, in some cases a fast query is better (especially in timed tests). It would be a good idea to have a configuration to the bigquery source to set this per-read.

Issue Links

• links to: GitHub Pull Request #4118
• links to: GitHub Pull Request #4118
• links to: GitHub Pull Request #4226
• links to: GitHub Pull Request #4606