Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5191

Add support for writing to BigQuery clustered tables

Details

    • Improvement
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • 2.6.0
    • 2.15.0
    • io-java-gcp

    Description

      Google recently added support for clustered tables in BigQuery. It would be useful to set clustering columns the same way as for partitioning. It should support multiple fields (4) for clustering.

      For example:

      BigQueryIO.Write<T> .withClustering(new Clustering().setField("productId").setType("STRING"))

      Attachments

        Activity

          People

            jeff.klukas@gmail.com Jeff Klukas
            robertsahlin Robert Sahlin
            Votes:
            7 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 16.5h
                16.5h