[BEAM-12362] BigQuery sink swallows HttpErrors when performing streaming inserts preventing retries

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: 2.30.0
• Component/s: io-java-gcp
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Chamikara Madhusanka Jayalath
• Created: 18/May/21 22:10
• Updated: 19/May/21 22:41
• Resolved: 19/May/21 22:41

Description

Relavent code is here: https://github.com/apache/beam/blob/158e177adc987cdc35c6a58b5292b4999c2139c3/sdks/python/apache_beam/io/gcp/bigquery_tools.py#L644

Only affects Python BigQuery sink when writing using streaming inserts.

Seems like this was introduced in https://github.com/apache/beam/pull/13217 hence Beam versions 2.27.0 and later are affected.

Issue Links

• links to: GitHub Pull Request #14837
• links to: GitHub Pull Request #14843