Details
-
Bug
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
When reading bigquery data where a field of type BYTES contains a None value I get the following error:
Traceback (most recent call last): File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/runners/direct/executor.py", line 343, in call finish_state) File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/runners/direct/executor.py", line 383, in attempt_call result = evaluator.finish_bundle() File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/runners/direct/transform_evaluator.py", line 319, in finish_bundle bundles = _read_values_to_bundles(reader) File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/runners/direct/transform_evaluator.py", line 306, in _read_values_to_bundles read_result = [GlobalWindows.windowed_value(e) for e in reader] File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/runners/direct/transform_evaluator.py", line 306, in <listcomp> read_result = [GlobalWindows.windowed_value(e) for e in reader] File "/mnt/c/Users/Juta/Documents/02-projects/apache/beam/sdks/venv/lib/python3.5/site-packages/apache_beam/io/gcp/bigquery_tools.py", line 932, in __iter__ row.f[i].v.string_value = row.f[i].v.string_value.encode('utf-8') AttributeError: 'NoneType' object has no attribute 'string_value'
This bug was introduced in https://github.com/apache/beam/pull/8621 and is present in the 2.13 release.
I submitted a pr to fix the issue: https://github.com/apache/beam/pull/8817
