Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9675

BigQueryStorageStreamSource reader quota issues at split time

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • 2.19.0
    • None
    • io-java-gcp
    • None

    Description

      The BigQuery Storage API returns an empty SplitStreamResponse when a stream cannot be split any further. The BigQueryStorageStreamSource reader should honor this response and not make further split calls for a stream when such a response is encountered; continuing to attempt splits leads to unnecessary quota exhaustion for management plane API calls.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kjung520 Kenneth Jung
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: