[BEAM-7108] Support for writing to partitioned and clustered BigQuery tables using Python

• Type: New Feature
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: io-java-gcp
• Assignee: Unassigned
• Reporter: Olivier Van Goethem
• Created: 18/Apr/19 15:42
• Updated: 04/Jun/22 01:49

Description

According to the BigQuery sink docs:

BigQuery sink currently does not fully support writing to BigQuery time partitioned tables. But writing to a *single* partition may work if that does not involve creating a new table (for example, when writing to an existing table with `create_disposition=CREATE_NEVER` and `write_disposition=WRITE_APPEND`).

The sink should support partitioning (and clustering).