Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8745

More fine-grained controls for the size of a BigQuery Load job

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.19.0
    • Component/s: io-java-gcp
    • Labels:
      None

      Description

      Users have hit problems where load jobs into very wide tables (100s of columns) are very slow, and sometimes fail. Feedback from BigQuery is that for very wide tables, smaller load jobs can avoid failures, and slowdowns.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jeff.klukas@gmail.com Jeff Klukas
                Reporter:
                pabloem Pablo Estrada
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m