[BEAM-1235] BigQueryIO doesn't show the load job error to the user

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: io-java-gcp
• Assignee: Pei He
• Reporter: Eugene Kirpichov
• Created: 31/Dec/16 17:36
• Updated: 16/May/20 13:56
• Resolved: 27/Jan/17 03:09

Description

When a BigQuery load job fails, we only say that it failed, but don't show the error message.

https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339 doesn't put the jobStatus in the exception, and https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332 doesn't even log it.

User who hit the issue: http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk (though this is using the Dataflow SDK so it'll need to be backported from Beam to Dataflow, or the user will need to use Beam once the issue is fixed)

Issue Links

• links to: GitHub Pull Request #1823