Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10792

ReadFromBigQuery fails with ValueProvider for table

    XMLWordPrintableJSON

    Details

      Description

      2 errors are present:

      1. ReadFromBigQuery passing a ValueProvider for the table param gets this error:

      '_CustomBigQuerySource' object has no attribute 'dataset'

      File "./lib/python3.7/site-packages/apache_beam/io/gcp/bigquery.py", line 656, in estimate_size self.table_reference.get(), self.dataset, self.project)

      There are a 2 places where self.dataset are referenced, but it is never set to any value in the CustomBigQuerySource class.  This should be set _init_() method.

      2. _export_files references table_ref as a str before checking if its a ValueProvider.

        Attachments

          Activity

            People

            • Assignee:
              mballou Michael Ballou
              Reporter:
              mballou Michael Ballou
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: