Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1235

BigQueryIO doesn't show the load job error to the user

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 0.5.0
    • io-java-gcp
    • None

    Description

      When a BigQuery load job fails, we only say that it failed, but don't show the error message.

      https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339 doesn't put the jobStatus in the exception, and https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332 doesn't even log it.

      User who hit the issue: http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk (though this is using the Dataflow SDK so it'll need to be backported from Beam to Dataflow, or the user will need to use Beam once the issue is fixed)

      Attachments

        Issue Links

          Activity

            People

              peihe0@gmail.com Pei He
              jkff Eugene Kirpichov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: