[BEAM-8995] apache_beam.io.gcp.bigquery_read_it_test failing on Py3.5 PC with: TypeError: the JSON object must be str, not 'bytes'

• Type: Bug
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.19.0
• Component/s: io-py-gcp
• Sprint: The Big 2020 Sprint
• Assignee: Kamil Wasilewski
• Reporter: Brian Hulette
• Created: 18/Dec/19 21:14
• Updated: 13/Apr/23 11:00
• Resolved: 02/Jan/20 08:59

Description

Sample failure: https://builds.apache.org/job/beam_PostCommit_Python35/1254/
(also includes two other failures on the same tests due to BEAM-8988)

Triggered by https://github.com/apache/beam/pull/9772

Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/site-packages/dataflow_worker/batchworker.py", line 649, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.5/site-packages/dataflow_worker/executor.py", line 176, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.5/site-packages/apache_beam/io/concat_source.py", line 86, in read
    range_tracker.sub_range_tracker(source_ix)):
  File "/usr/local/lib/python3.5/site-packages/apache_beam/io/textio.py", line 206, in read_records
    yield self._coder.decode(record)
  File "/usr/local/lib/python3.5/site-packages/apache_beam/io/gcp/bigquery.py", line 557, in decode
    value = json.loads(value)
  File "/usr/local/lib/python3.5/json/__init__.py", line 312, in loads
    s.__class__.__name__))
TypeError: the JSON object must be str, not 'bytes'