[ARROW-2591] [Python] Segmentation fault when writing empty ListType column to Parquet

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.0
• Fix Version/s: 0.12.0
• Component/s: Python
• Labels: parquet pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18976
• Assignee: Krisztian Szucs
• Reporter: jacques
• Created: 16/May/18 16:48
• Updated: 11/Jan/23 07:21
• Resolved: 26/Nov/18 08:42

Description

Context Is the following: I am currently dealing with sparse column serialization in parquet. In some cases, many lines are empty I can also have columns containing only empty lists.
However I got a segmentation fault when I try to write in parquet thoses columns filled only with empty lists.

Here is a simple code snipet reproduces the segmentation fault I had:

In [1]: import pyarrow as pa

In [2]: import pyarrow.parquet as pq

In [3]: pa_ar = pa.array([[],[]],pa.list_(pa.int32()))

In [4]: table = pa.Table.from_arrays([pa_ar],["test"])

In [5]: pq.write_table(
   ...:     table=table,
   ...:     where="test.parquet",
   ...:     compression="snappy",
   ...:     flavor="spark"
   ...: )
Segmentation fault

May I have it fixed?

Best

Jacques

Issue Links

• links to: GitHub Pull Request #3028