[BEAM-4096] BigQueryIO ValueProvider support for NumFileShards and Triggering Frequency

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Affects Version/s: 2.4.0
• Component/s: io-java-gcp
• Assignee: Unassigned
• Reporter: Ryan McDowell
• Created: 17/Apr/18 00:35
• Updated: 03/Jun/22 20:26

Description

Enhance BigQueryIO to accept ValueProviders for:

• withTriggeringFrequency(..)
• withNumFileShards(..)

It would allow Dataflow templates to accept these parameters at runtime instead of being hardcoded. This opens up the ability to create Dataflow templates which allow users to flip back-and-forth between batch and streaming inserts.

withMethod(..) cannot be changed at runtime currently.