[BEAM-11408] GCP BigQuery sink (streaming inserts) uses runner determined sharding

• Type: Improvement
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: 2.28.0
• Component/s: io-java-gcp
• Assignee: Siyuan Chen
• Reporter: Siyuan Chen
• Created: 07/Dec/20 17:41
• Updated: 13/Apr/21 04:13
• Resolved: 29/Jan/21 22:08

Description

Integrate BigQuery sink with shardable `GroupIntoBatches` (BEAM-10475) to allow runner determined dynamic sharding.

Issue Links

• is related to: BEAM-12079 Deterministic coding enforcement causes _StreamToBigQuery/CommitInsertIds/GroupByKey to fail
• links to: [Github] Pull Request #14133 (nehsyc)
• links to: GitHub Pull Request #13496
• links to: GitHub Pull Request #13832
• links to: GitHub Pull Request #13859
• links to: GitHub Pull Request #14033
• links to: GitHub Pull Request #14499