Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8995

apache_beam.io.gcp.bigquery_read_it_test failing on Py3.5 PC with: TypeError: the JSON object must be str, not 'bytes'

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.19.0
    • Component/s: io-py-gcp
    • Labels:
      None
    • Sprint:
      The Big 2020 Sprint

      Description

      Sample failure: https://builds.apache.org/job/beam_PostCommit_Python35/1254/
      (also includes two other failures on the same tests due to BEAM-8988)

      Triggered by https://github.com/apache/beam/pull/9772

      Dataflow pipeline failed. State: FAILED, Error:
      Traceback (most recent call last):
        File "/usr/local/lib/python3.5/site-packages/dataflow_worker/batchworker.py", line 649, in do_work
          work_executor.execute()
        File "/usr/local/lib/python3.5/site-packages/dataflow_worker/executor.py", line 176, in execute
          op.start()
        File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
        File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start
        File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
        File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
        File "/usr/local/lib/python3.5/site-packages/apache_beam/io/concat_source.py", line 86, in read
          range_tracker.sub_range_tracker(source_ix)):
        File "/usr/local/lib/python3.5/site-packages/apache_beam/io/textio.py", line 206, in read_records
          yield self._coder.decode(record)
        File "/usr/local/lib/python3.5/site-packages/apache_beam/io/gcp/bigquery.py", line 557, in decode
          value = json.loads(value)
        File "/usr/local/lib/python3.5/json/__init__.py", line 312, in loads
          s.__class__.__name__))
      TypeError: the JSON object must be str, not 'bytes'
      

        Attachments

          Activity

            People

            • Assignee:
              kamilwu Kamil Wasilewski
              Reporter:
              bhulette Brian Hulette
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: