[BEAM-4538] readAll for BigQuery IO

• Type: Wish
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: io-java-gcp
• Assignee: Unassigned
• Reporter: Ahmet Altay
• Created: 12/Jun/18 03:57
• Updated: 03/Jun/22 22:04

Description

Customer reported:

"""

BigQueryIO.readTableRows() does not support reading partitions specified by side inputs; the only way to select partitions is to know them ahead of time and pass them in on the command line in PipelineOptions for selection in a WHERE clause.
 
Ideally we'd have something like a readAll() transform, like we have for TextIO, JdbcIO etc. that allows the reading configuration to be dynamic in a sense.
"""