[BEAM-11731] numpy 1.20.0 breaks dataframe io_test.test_read_write_10_parquet and mypy

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Affects Version/s: 2.26.0, 2.27.0
• Fix Version/s: Not applicable
• Component/s: test-failures
• Assignee: Brian Hulette
• Reporter: Kyle Weaver
• Created: 01/Feb/21 18:31
• Updated: 28/Apr/21 17:25
• Resolved: 12/Mar/21 17:56

Description

pyarrow.lib.ArrowTypeError: ("Did not pass numpy.dtype object [while running '_WriteToPandas/WriteToFiles/ParDo(_WriteUnshardedRecordsFn)/ParDo(_WriteUnshardedRecordsFn)']", 'Conversion failed for column rank with type int64')

https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/17083/testReport/junit/apache_beam.dataframe.io_test/IOTest/test_read_write_10_parquet/

Issue Links

• links to: GitHub Pull Request #13870
• links to: GitHub Pull Request #13875
• links to: GitHub Pull Request #13892