[HOP-3944] Beam BigQuery Output : throw error for invalid field names

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Beam, BigQuery
• Assignee: Matt Casters
• Reporter: Matt Casters
• Created: 17/May/22 17:18
• Updated: 19/May/22 15:17
• Resolved: 19/May/22 15:17

Description

Invalid BigQuery field names in a table are not handled gracefully by Apache Beam on Dataflow.  It would be best if Hop validates the field names before even attempting to run.

See: https://cloud.google.com/bigquery/docs/schemas#column_names

Issue Links

• links to: GitHub Pull Request #1492