[BEAM-5626] Several IO tests fail in Python 3 with RuntimeError('dictionary changed size during iteration',)}

• Type: Sub-task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.8.0
• Component/s: sdk-py-core
• Assignee: Ruoyun Huang
• Reporter: Valentyn Tymofieiev
• Created: 03/Oct/18 05:24
• Updated: 16/May/20 13:55
• Resolved: 08/Oct/18 23:34

Description

ERROR: test_delete_dir (apache_beam.io.hadoopfilesystem_test.HadoopFileSystemTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/apache_beam/io/hadoopfilesystem_test.py", line 506, in test_delete_dir
self.fs.delete([url_t1])
File "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/apache_beam/io/hadoopfilesystem.py", line 370, in delete
raise BeamIOError("Delete operation failed", exceptions)
apache_beam.io.filesystem.BeamIOError: Delete operation failed with exceptions

{'hdfs://test_dir/new_dir1': RuntimeError('dictionary changed size during iteration', )}

Issue Links

• blocks: BEAM-5315 Finish Python 3 porting for io module
• links to: GitHub Pull Request #6587
• links to: GitHub Pull Request #6628