[ARROW-13681] [C++] list_parent_indices only computes for first chunk

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.0.0, 5.0.1
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/29317
• Assignee: Antoine Pitrou
• Reporter: Tor Eivind McKenzie-Syvertsen
• Created: 20/Aug/21 12:33
• Updated: 11/Jan/23 08:34
• Resolved: 24/Aug/21 16:58

Description

Pyarrow version: 5.0.0. 
Python version: 3.7.9

I came across this issue due to very unexpected behaviour from the "explode" function obtained here:

https://issues.apache.org/jira/browse/ARROW-12099
indices = pc.list_parent_indices(table[col_name])

if table[column] in this example contains several chunks, the indices will look perfectly fine for that chunk, but erratic and unexpected results for second chunk.
No warning or info was given either

A workaround that solved the problem for me is:

  indices = pc.list_parent_indices(table.combine_chunks()[col_name])

The behaviour then changes dramatically.

I'm assuming this isnt expected and should be fixed?

Issue Links

• links to: GitHub Pull Request #10985