[BEAM-6711] Bigquery Tornadoes IT is broken in Python3 PostCommit test suite.

• Type: Sub-task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.12.0
• Component/s: sdk-py-core
• Assignee: Pablo Estrada
• Reporter: Valentyn Tymofieiev
• Created: 19/Feb/19 18:22
• Updated: 16/May/20 13:56
• Resolved: 27/Mar/19 17:51

Description

First failure was observed in https://builds.apache.org/job/beam_PostCommit_Python3_Verify/54 , after

https://github.com/apache/beam/commit/cdea885872b3be7de9ba22f22700be89f7d53766 was merged.

pabloem, could you please take a look? I suggest we do a rollback + rollforward with a fix.

root: ERROR: Exception at bundle <apache_beam.runners.direct.bundle_factory._Bundle object at 0x7f35e5331240>, due to an exception.
 Traceback (most recent call last):
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify/src/sdks/python/apache_beam/runners/common.py", line 727, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify/src/sdks/python/apache_beam/runners/common.py", line 556, in invoke_process
    windowed_value, additional_args, additional_kwargs, output_processor)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify/src/sdks/python/apache_beam/runners/common.py", line 622, in _invoke_per_window
    self.process_method(*args_for_process, **kwargs_for_process))
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify/src/sdks/python/apache_beam/runners/common.py", line 823, in process_outputs
    for result in results:
  File "/home/jenkins/jenkins-slave/works
pace/beam_PostCommit_Python3_Verify/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py", line 191, in process
    if destination in self._destination_to_file_writer:
TypeError: unhashable type: 'TableReference'

Issue Links

• links to: GitHub Pull Request #7885
• links to: GitHub Pull Request #7892