[BEAM-4685] Allow writing to time partitioned tables when CreateDisposition==CREATE_NEVER

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Duplicate
• Fix Version/s: Not applicable
• Component/s: io-java-gcp
• Assignee: Unassigned
• Reporter: Chamikara Madhusanka Jayalath
• Created: 28/Jun/18 20:52
• Updated: 16/May/20 14:06
• Resolved: 13/Sep/19 20:22

Description

Writing to time partitioned table fails when CreateDisposition==CREATE_NEVER with error "Table with field based partitioning must have a schema".

This seems to be due to BigQuery not setting schema for this case.

https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L114

 

Issue Links

• duplicates: BEAM-4364 BigQueryIO.writeTableRows() and withTimePartitioning() fails with CreateDisposition.CREATE_NEVER