[BEAM-3137] BigQueryIO.write() should better verify user schemas

• Type: Bug
• Status: Resolved
• Priority: P4
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Component/s: io-java-gcp
• Assignee: Eugene Kirpichov
• Reporter: Eugene Kirpichov
• Created: 02/Nov/17 19:54
• Updated: 24/Jul/20 20:19
• Resolved: 20/Nov/17 21:58

Description

BigQueryIO.write() currently misses the following schema-related validations which can lead to confusing errors:

• withSchemaFromView() doesn't check that the passed view is not null
• When using withSchemaFromView(), there's no run-time check that the view actually contains the TableDestination referenced by the tableFn - instead it may issue a load job with no schema

There might be more validations missing.

Issue Links

• links to: GitHub Pull Request #4075