[ARROW-9991] [C++] split kernels for strings/binary

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26016
• Assignee: Maarten Breddels
• Reporter: Maarten Breddels
• Created: 14/Sep/20 07:46
• Updated: 11/Jan/23 08:10
• Resolved: 19/Oct/20 14:33

Description

Similar to Python str.split and bytes.split, we'd like to have a way to convert str into list[str] (and similarly for bytes).

When the separator is given, the algorithms for both types are the same. Python, however, overloads strip. When given no separator, the algorithm will split considering all whitespace (unicode for str, ascii for bytes) as separator.

I'd rather see not too much overloaded kernels, e.g.

binary_split (takes string/binary separator, and maxsplit arg, no special utf8 version needed)

utf8_split_whitespace (similar to Python's version given no separator)

ascii_split_whitespace (similar to Python's version given no separator, but considering ascii, although this could work on any binary data)

there can also be rsplit versions of these, or they could be an argument.

 

Issue Links

• is a child of: ARROW-555 [C++] String algorithm library for StringArray/BinaryArray
• is depended upon by: ARROW-11515 [R] Bindings for strsplit
• links to: GitHub Pull Request #8271