Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9243

bigqueryio for Go is doesn't support standard SQL

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • P2
    • Resolution: Unresolved
    • None
    • None
    • io-go-gcp
    • None

    Description

      It appears that bigqueryio for Go is hardcoded to use legacy SQL, with no way to use standard SQL. The BQ API will still reject the request if you use the #stardardSQL comment/flag in the query since the sql version is set explicitly in the API call.

       

      https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/io/bigqueryio/bigquery.go#L127

       

      Seems like we can pass an options param into the Query function to provide this setting among others. I will take a look at doing this. LMK if there is another stylistic approach to consider.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-4634 Use Standard SQL in biqueryio transform

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved

          Activity

            People

              Unassigned Unassigned
              sdotz Stephen Dotz
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: