[ARROW-7731] [C++][Parquet] Support LargeListArray

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.17.1
• Component/s: C++
• Labels: parquet
• External issue URL: https://github.com/apache/arrow/issues/23971
• Assignee: Micah Kornfield
• Reporter: marc abboud
• Created: 31/Jan/20 10:00
• Updated: 11/Jan/23 07:55
• Resolved: 01/Sep/20 04:14

Description

For now it's not possible to write a pyarrow.Table containing a LargeListArray in parquet. The lines

from pyarrow import parquet
import pyarrow as pa

indices = [1, 2, 3]
indptr = [0, 1, 2, 3]
q = pa.lib.LargeListArray.from_arrays(indptr, indices) 
table = pa.Table.from_arrays([q], names=['no']) 

parquet.write_table(table, '/test')

yields the error 

ArrowNotImplementedError: Unhandled type for Arrow to Parquet schema conversion: large_list<item: int64>

 

Issue Links

• is related to: ARROW-10172 [Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity overflows