[ARROW-6067] [Python] Large memory test failures

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.1
• Fix Version/s: 0.15.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/22468
• Assignee: Wes McKinney
• Reporter: Antoine Pitrou
• Created: 30/Jul/19 07:48
• Updated: 11/Jan/23 07:44
• Resolved: 20/Aug/19 17:20

Description

I get the following errors when running pytest --large_memory:

____________________________________________________________________ test_chunked_binary_error_message _____________________________________________________________________
Traceback (most recent call last):
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_feather.py", line 566, in test_chunked_binary_error_message
    write_feather(df, io.BytesIO())
  File "/home/antoine/arrow/dev/python/pyarrow/feather.py", line 182, in write_feather
    writer.write(df)
  File "/home/antoine/arrow/dev/python/pyarrow/feather.py", line 96, in write
    check_chunked_overflow(col)
  File "/home/antoine/arrow/dev/python/pyarrow/feather.py", line 68, in check_chunked_overflow
    "lifted in the future".format(col.name))
AttributeError: 'pyarrow.lib.ChunkedArray' object has no attribute 'name'
_______________________________________________________________ TestConvertStructTypes.test_from_numpy_large _______________________________________________________________
Traceback (most recent call last):
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_pandas.py", line 2010, in test_from_numpy_large
    assert arr.num_chunks == 2
AttributeError: 'pyarrow.lib.StructArray' object has no attribute 'num_chunks'

Issue Links

• links to: GitHub Pull Request #5128