Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5191

Add support for writing to BigQuery clustered tables

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.15.0
    • Component/s: io-java-gcp
    • Labels:

      Description

      Google recently added support for clustered tables in BigQuery. It would be useful to set clustering columns the same way as for partitioning. It should support multiple fields (4) for clustering.

      For example:

      BigQueryIO.Write<T> .withClustering(new Clustering().setField("productId").setType("STRING"))

        Attachments

          Activity

            People

            • Assignee:
              jeff.klukas@gmail.com Jeff Klukas
              Reporter:
              robertsahlin Robert Sahlin
            • Votes:
              7 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 16.5h
                16.5h